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Abstract 

Current  moisture  initialization  sources  lack  the  spatial  and  temporal  resolution  required  for  mesoscale 
moisture  forecast  accuracy  critical  for  military  operations.  The  Global  Positioning  System  (GPS)  satellite 
constellation  provides  an  opportunity  to  extract  accurate  moisture  observations  based  on  the  refraction  of 
the  GPS  signal  through  the  troposphere.  GPS-derived  precipitable  water  (PW)  from  two  different  research 
areas  was  independently  compared  with  the  Air  Force  Weather  Agencys  (AFWAs)  MM5  PW  model 
output.  Results  were  concurrent  with  similar  studies  comparing  GPS-derived  PW  with  numerical  weather 
models.  The  mean  correlation  in  CONUS  was  92.5%,  while  in  Alaska  it  was  72.8%.  Mean  model  biases 
were  1.22  mm  in  CONUS  and  0.69  mm  in  Alaska.  Mean  RMSEs  were  4.36  mm  in  CONUS  and  2.76  mm 
in  Alaska.  In  addition,  comparisons  were  made  between  moist  and  dry  locations,  showing  a  21.5% 
difference  in  correlation  and  a  17.8%  difference  in  RMSE.  The  GPS  networks  superior  temporal 
resolution  captured  the  diurnal  variations  in  PW,  while  the  model  consistently  failed  to  take  such 
variations  into  account  as  its  forecast  progressed.  This  seems  it  could  be  the  largest  source  of  error 
between  the  two  data  sets.  A  number  of  non-meteorological  error  sources  exist  that  could  impact  use  of 
GPS-derived  PW  in  operational  applications,  such  as  terrain  differences  between  the  GPS  receiver  sites 
and  the  model  interpolated  heights.  These  error  sources  need  to  be  further  addressed  prior  to  operational 
assimilation  of  this  data  into  military  weather  models. 
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Abstract 

Current  moisture  initialization  sources  lack  the  spatial  and  temporal  resolution 
required  for  mesoscale  moisture  forecast  accuracy  critical  for  military  operations.  The 
Global  Positioning  System  (GPS)  satellite  constellation  provides  an  opportunity  to 
extract  accurate  moisture  observations  based  on  the  refraction  of  the  GPS  signal  through 
the  troposphere.  GPS-derived  precipitable  water  (PW)  from  two  research  areas  was 
independently  compared  with  the  Air  Force  Weather  Agency’s  (AFWA’s)  MM5  PW 
model  output.  Results  were  concurrent  with  similar  studies  comparing  GPS-derived  PW 
with  numerical  weather  models.  The  mean  correlation  between  the  GPS-derived  PW 
values  and  MM5  output  in  CONUS  was  92.5%,  while  in  Alaska  it  was  72.8%.  Mean 
model  biases  between  the  two  data  sets  were  -1.22  mm  in  CONUS  and  0.69  mm  in 
Alaska,  where  a  positive  bias  signifies  the  GPS  network  having  higher  PW  values.  Mean 
root  mean  square  errors  were  4.36  mm  in  CONUS  and  2.76  mm  in  Alaska.  In  addition, 
comparisons  were  made  between  moist  and  dry  locations  as  well  as  inland  and  coastal 
locations,  and  a  special  study  was  done  comparing  GPS  receiver  site  elevation  and 
standard  deviation. 

The  GPS  network’s  superior  temporal  resolution  captured  the  diurnal  variations  in 
PW,  while  the  model  consistently  failed  to  take  such  variations  into  account  as  its 
forecast  progressed.  This  difference  in  diurnal  patterns  seems  to  be  the  largest  source  of 
error  between  the  GPS  and  MM5  data  sets.  A  number  of  non-meteorological  error 
sources  exist  that  could  impact  use  of  GPS-derived  PW  in  operational  applications,  such 


x 


as  terrain  differences  between  the  GPS  receiver  sites  and  the  model  interpolated  heights. 
These  error  sources  need  to  be  further  addressed  prior  to  operational  assimilation  of  this 
data  into  military  weather  models. 
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GPS-DERIVED  PRECIPITABLE  WATER  COMPARED  WITH  THE  AIR  FORCE 
WEATHER  AGENCY’S  MM5  MODEL  OUTPUT 


I.  Introduction 


1.1  Background 

Global  Positioning  System  (GPS)-derived  precipitable  water  (PW)  provides 
unprecedented  spatial  and  temporal  resolution  of  water  vapor,  a  highly  variable 
parameter  that  is  currently  very  difficult  to  initialize  accurately.  By  measuring  the  “wet 
delay”  of  a  transmission  to  a  GPS  receiver,  where  the  delay  is  proportional  to  the 
integrated  water  vapor,  it  is  possible  to  remotely  sense  a  line-of-sight  precipitable  water 
amount  for  a  given  transmission  time  and  receiver  location.  This  parameter  can  be 
normalized  into  an  estimate  of  a  vertically  integrated  precipitable  water  value.  In  order 
to  produce  the  most  accurate  water  vapor  measurement,  the  GPS  receiver  must  have  a 
means  to  measure  temperature  and  sea  level  pressure  concurrently. 

1.1.1  Delays  in  the  GPS  Signal.  The  Global  Positioning  System  was  established 
by  the  U.S.  government  in  the  early  1980s  as  a  crucial  element  in  navigation  and  relative 
positioning.  Today,  GPS  includes  a  constellation  of  24  low-earth-orbit  (LEO)  satellite 
vehicles  that  transmit  signals  in  the  L-band  (1.2  and  1.6  GHz)  to  terrestrial  users 
equipped  with  receivers.  These  signals  are  converted  into  infonnation  to  aid  in 
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navigation,  timing,  and  positioning,  not  only  for  military  assets,  but  also  for  many 
civilian  uses  (Trimble  1996). 

Due  to  the  requirement  for  highly  accurate  GPS  readouts  in  every  transmission, 
post-processing  procedures  have  been  developed  to  factor  out  the  signal  delays  from  each 
of  these  transmissions.  These  delays  are  excess  path  lengths  due  to  the  phase  shifting 
between  the  standing  signal  and  the  transmission  signal  and  are  factored  out  of  the  signal 
through  post-processing  at  the  receiver  end  of  the  transmission.  There  are  two  major 
components  of  the  GPS  signal  delay:  the  hydrostatic  delay  and  the  wet  delay. 

Hydrostatic  delay  arises  from  the  nondipole  moment  of  the  total  atmosphere. 

This  part  of  the  delay  factors  in  all  constituents  of  the  neutral  atmosphere  (to  include 
nitrogen,  oxygen,  argon,  and  other  trace  gases)  including  a  component  of  water  vapor. 
These  constituents  have  relatively  unifonn  composition  in  the  troposphere.  Using  a 
surface  pressure  measurement,  the  hydrostatic  delay  is  calculated.  With  surface  pressure 
measurements,  the  hydrostatic  delay  can  be  measured  to  better  than  1  mm  (Businger 
1996). 

The  wet  delay  arises  from  the  refractivity  of  the  water  vapor  in  the  neutral 
atmosphere.  Due  to  the  variability  of  water  vapor  in  the  tropopause,  the  wet  delay  can 
vary  from  10  mm  in  desert  regions  to  more  than  400  mm  in  more  humid  regions.  Not 
only  is  there  an  excellent  spatial  variability  in  wet  delay,  but  there  also  exists  a 
significant  temporal  variability.  When  the  wet  delay  is  measured  in  the  zenith  direction, 
a  simple  relationship  exists  from  which  precipitable  water  can  be  measured. 
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1.1.2  Research  Efforts  in  GPS  Meteorology.  Exploiting  the  GPS  signal  delay  for 
meteorological  applications  is  a  relatively  young  endeavor,  with  the  GPS  network  only 
having  been  in  operation  since  the  mid-1980s.  GPS  meteorology  shows  considerable 
promise  for  both  short-  and  long-term  meteorological  applications,  including 
climatology.  In  addition,  research  is  ongoing  for  the  assimilation  of  GPS  water  vapor 
data  into  larger-scale  forecast  models,  the  mapping  of  global  water  vapor  patterns  in  a 
manner  similar  to  computerized  axial  tomography  (CAT  scanning),  and  the 
measurements  of  atmospheric  refractivity  soundings  via  radio  occultation  to  gather  global 
information  about  temperature,  humidity  and  ionospheric  structures  (Ware  2000). 

1.1.3  Precipitable  Water  in  the  AFWA  MM5.  The  Fifth  Generation  Mesoscale 
Model  (MM5)  is  a  three-dimensional,  non-hydro  static,  primitive-equation,  nest-grid 
model  with  a  terrain  following  sigma  (a)  vertical  coordinate  system  (Grell  1995).  It  is 
the  Air  Force  Weather  Agency’s  (AFWA’s)  weather  forecast  model  of  choice.  As  of  this 
writing,  AFWA  runs  MM5  windows  over  29  worldwide  mission  critical  theaters  of 
operations.  AFWA  maintains  18  parent  domains,  from  which  1 1  inner  nest  windows  are 
derived  (Applequist  2001). 

Kuo  (1993)  has  already  shown  that  precipitable  water,  despite  being  a  two- 
dimensional  variable,  can  be  aptly  assimilated  into  the  MM5.  Therefore,  it  is  plausible 
that  with  its  exceptional  temporal  and  spatial  resolution,  GPS-derived  precipitable  water 
can  be  a  valuable  input  for  modeling  tenuous  water  vapor  variables. 

Gutman  (2001)  has  offered  theories  on  how  GPS  PW  can  be  integrated  into 
mesoscale  models  by  using  a  vertical  aliasing  technique,  similar  to  the  one  mentioned  by 
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Kuo  (1993).  Gutman  shows  a  case  study  in  which  GPS  PW  was  assimilated  into  the 
National  Center  for  Environmental  Prediction’s  (NCEP’s)  Rapid  Update  Cycle  2  (RUC- 
2)  mesoscale  forecast  model.  In  addition,  he  cites  previous  studies  in  which  it  has  been 
shown  that  the  most  vertical  variability  in  the  integrated  vertical  moisture  profile  is  in  the 
lower  4000  m. 

Currently,  AFWA  uses  the  Multivariate  Optimal  Interpolation  (MVOI)  scheme  to 
assimilate  its  data  for  use  by  the  MM5.  MVOI  uses  point  analyses  in  the  vertical  to 
derive  vertical  profiles  of  temperature,  winds,  and  moisture.  GPS-derived  moisture 
products  are  currently  not  assimilated  into  the  MM5  (partly  due  to  the  form  of 
assimilation  technique).  By  summer  2002,  AFWA’s  analysis  scheme  will  transition  from 
MVOI  to  the  3-Dimensional  Variational  Analysis  (3DVAR)  system.  This  method  is 
designed  to  employ  more  data  sources  along  with  parallelization  techniques  to  compile 
more  information  in  a  comparable  amount  of  time  (Ritz  et  al.  2001).  This  future 
transition  provides  more  validity  to  this  research,  for  3DVAR  will  be  able  to  ingest  the 
GPS-derived  products  for  initialization. 

1.2  Problem  Statement 

Currently,  GPS-derived  PW  is  not  assimilated  into  any  operational  weather 
model,  due  to  a  number  of  factors.  Less  than  100  sensors  are  available  in  the  continental 
United  States  (CONUS),  and  less  then  100  sensors  are  available  throughout  Europe. 
While  the  receiver  density  is  currently  comparable  to  the  upper-air  sounding  network, 
inconsistencies  with  the  GPS  receivers  and  the  delay-processing  software  result  in  the 
meteorology  community’s  hesitation  to  fully  implement  the  network. 
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AFWA  traditionally  has  been  at  the  leading  edge  of  taking  advantage  of  new  data 
sources  for  operational  use.  For  example,  AFWA  was  at  the  forefront  of  using  GOES 
sounder  data  as  a  legitimate  data  source,  long  before  other  operational  centers  considered 
such  a  source  as  valid.  The  results  of  this  comparison  should  demonstrate  the  utility  of 
GPS-derived  PW  in  numerical  weather  prediction  applications,  however,  its  temporal 
resolution  would  make  it  of  best  use  in  a  variational  assimilation  system.  Through  this 
research,  AFWA  may  make  the  decision  to  assimilate  the  GPS-derived  PW  not  long  after 
their  3DVAR  assimilation  scheme  becomes  operational  in  2002. 

1.3  Research  Impact 

For  an  NWP  user  to  have  confidence  in  a  numerical  model,  it  is  important  for  the 
data  being  used  to  initialize  the  model  to  be  as  accurate  as  possible.  Today’s  numerical 
models  are  able  to  use  advanced  methods  to  aptly  blend  real-world  observation  data  with 
previously  obtained  model  output.  This  way,  the  model  is  less  likely  to  react  to 
contaminated  data. 

AFWA  is  at  the  forefront  of  incorporating  the  best  technology  to  optimize  model 
initialization.  It  uses  the  most  accurate  observation  data  with  the  highest  temporal  and 
spatial  resolution  that  is  computationally  possible. 

This  research  will  compare  GPS-derived  precipitable  water  with  the  output  from 
AFWA’s  MM5.  GPS-derived  precipitable  water  overcomes  the  challenges  that  exist  in 
other  moisture  observations.  For  example,  radiosonde  balloons  are  only  launched  every 
12  hours  from  a  network  of  sites  that  average  500  km  between  each  launch  site.  Also, 
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GOES  sounder  data  is  only  valid  in  clear-air  areas.  The  presence  of  cloud  water 
contaminates  the  data. 

Should  AFWA  begin  to  ingest  GPS-derived  PW,  the  model’s  moisture  output  will 
be  nudged  towards  truer  values  and  will  improve  the  overall  quality  of  the  model’s 
output:  more  valuable  forecast  data  for  our  nations’  warfighters. 

1.4  Research  Objective 

This  research  will  compare  GPS-derived  precipitable  water  (PW)  against  an 
operational  numerical  weather  prediction  (NWP)  forecast  model.  By  doing  an 
independent  data  comparison  in  two  of  AFWA’s  MM5  theaters  of  operation,  a  first-look 
analysis  will  be  performed  that  can  transition  to  the  next  step:  experimentally 
assimilating  the  new  data  into  the  model  initialization  itself.  Studies  have  already 
demonstrated  the  excellent  value  GPS-derived  PW  can  provide  to  other  forecast  models, 
both  by  independent  data  comparisons  as  well  as  by  legitimate  assimilations  into  the 
model.  This  will  be  the  first  study  involving  AFWA’s  operational  MM5  output  in  GPS- 
derived  PW  research. 

The  objective  will  be  to  assess  whether  GPS-derived  PW  is  a  value-added  data 
source,  in  particular,  a  recommendation  of  whether  the  AFWA  MM5  might  produce  more 
accurate  output  should  GPS-derived  PW  be  included.  With  the  advent  of  their  3DVAR 
initialization  scheme  in  mid-2002,  AFWA  will  be  able  to  ingest  the  PW  values  for 
operational  use.  Through  various  statistical  analyses,  quantitative  comparisons  will 
provide  the  reader  with  evidence  supporting  the  accomplishment  of  this  objective. 
Statistics  that  will  make  these  comparisons  include  correlation,  bias,  RMSE,  and  standard 
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deviation.  These  statistics  can  be  partitioned  into  various  categories,  such  as  model 
initialization  time,  forecast  integration  time,  and  location. 

1.5  Hypotheses 

Based  on  other  studies  that  will  be  detailed  in  Chapter  II,  this  research  is  expected 
to  show  a  reasonable  correlation  between  the  GPS-derived  PW  and  the  MM5  output. 
However,  the  errors  that  will  evolve  between  the  two  parameters  will  concur  with  errors 
that  already  exist  between  radiosonde-derived  PW  and  MM5  output:  the  MM5  has  a 
persistent  moist  bias. 

Variations  in  these  results  will  exist  in  the  different  theaters.  For  example,  the 
data  in  CONUS  will  have  a  continental  influence,  while  the  values  in  Alaska  will  have  a 
body  of  water  possibly  impacting  the  model  results.  In  addition,  the  differences  in  GPS 
receivers  and  processing  software  will  cause  varying  results.  Such  differences  will 
prevent  accurate  comparisons  between  the  two  theaters. 

Finally,  the  comparisons  between  the  GPS-derived  PW  and  the  radiosonde  values 
will  show  a  slight  bias,  but  this  bias  is  expected  to  be  well  within  the  error  tolerances  of 
both  measurement  sensors.  This  will  further  substantiate  AFWA  using  these  data  for 
model  initialization. 
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II.  Literature  Review 


2.1  The  Global  Positioning  System 

2.1.1  Historical  Perspective.  The  Global  Positioning  System  was  established  by 
the  U.S.  government  in  the  early  1980s  as  a  crucial  element  in  navigation  and  relative 
positioning.  Today’s  GPS  network  consists  of  24  or  more  low-earth  orbit  satellite 
vehicles  that  transmit  signals  in  the  LI  (1228  MHz)  and  L2  (1575  MHz)  bands  to 
terrestrial  users  that  are  equipped  with  receivers  (Leick  1990).  Until  May  2000,  the 
military  had  the  capability  to  exercise  Selective  Availability,  which  would  have 
intentionally  degraded  the  signal  for  national  security  purposes.  The  Clinton 
administration  ended  the  feature,  thus  giving  the  civilian  community  reliable  enhanced 
capabilities  (Leopold  2000).  Figures  1  and  2  show  diagrams  of  how  the  GPS  satellite 
vehicle  constellation  is  arranged  and  how  their  ground  tracks  ensure  global  coverage. 


Figure  1.  Schematic  of  the  GPS  Satellite  Vehicle  Constellation.  The  nominal  constellation  has  24  satellite 
vehicles  distributed  among  6  orbital  planes.  Altitude:  20,200  km.  Inclination  Angle:  55  degrees.  Courtesy 

of  Dana  (1999). 
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Peter II.  Dana  l<W9S 


Figure  2.  Diagram  of  the  Satellite  Coverage  Transposed  on  a  Global  Map  Projection.  Ground  tracks  are 
shown  over  a  24-hour  period  from  29-30  September  1998.  Courtesy  of  Dana  (1999). 

2.1.2  Determining  Location  with  GPS.  The  signals  disseminated  from  the 
satellite  vehicles  are  converted  into  time  and  distance  information.  For  a  GPS  location 
calculation  two  steps  are  required:  phase  shifting  of  the  pseudorandom  codes  and 
trilateration. 

Phase  shifting  of  the  pseudorandom  code  is  the  first  step  in  determining  ground 
position.  Each  satellite  vehicle  transmits  a  signal  of  binary  code  (ones  and  zeroes).  The 
ground  receiver  intercepts  this  code,  and  then  times  its  own  code  to  match  the  satellite 
vehicle’s  transmission.  The  time  it  takes  for  the  receiver  to  match  up  its  code,  multiplied 
by  the  speed  of  light,  gives  the  ground  the  receiver  the  distance  it  is  from  the  satellite 
vehicle  (Leick  1990). 

Trilateration  is  the  process  of  determining  distance  from  sighting  at  least  four 
satellite  vehicles  from  any  ground  positioned  receiver  on  earth.  The  fourth  satellite 
vehicle  is  required  to  resolve  receiver  clock  errors.  When  a  ground  receiver  is  able  to 
determine  its  distance  from  the  satellite  vehicles,  the  receiver  can  then  use  trilateration  to 
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determine  its  precise  location  on  the  earth’s  geoid  (Figure  3).  By  imagining  each 
satellite’s  range  as  a  sphere,  the  intersection  of  the  spheres  will  constitute  the  location 
(Trimble  1996). 


Figure  3.  Visualization  of  How  GPS  Determines  Precise  Location.  Courtesy  of  Dana  (1999). 

2.1.3  The  Current  Status  and  Future  of  GPS.  Currently,  the  GPS  network 
satellite  vehicles  are  on  the  Block  HR  build,  manufactured  by  Lockheed-Martin.  This 
constellation  was  emplaced  in  1995,  and  each  satellite  is  anticipated  to  have  a  10-year 
design  life  (Hofmann-Wellenhof  1993).  In  anticipation  of  the  expiration  of  the  Block  HR 
systems,  Boeing  Satellite  Systems  is  expected  to  begin  GPS  Block  IIF  production  by  the 
end  of  2002,  with  the  first  satellite  scheduled  for  a  2005  delivery.  In  addition,  the 
Department  of  Defense  was  expected  to  request  proposals  for  the  Block  III  design  in  Fall 
2001  (Smith  2001).  These  plans  will  ensure  reliable  coverage. 
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2.2  Use  of  GPS  for  Meteorological  Research 

It  has  only  been  in  the  past  decade  that  geodesists  and  meteorologists  have 
discovered  the  relationship  between  GPS  receiver  transmissions  and  the  water  vapor  in 
the  troposphere  overlying  the  receiver  site.  Meteorologists  are  interested  in  taking 
advantage  of  this  relationship  due  to  its  high  temporal  and  spatial  resolution,  as  well  as 
the  portability  and  economy  of  the  measurement  devices.  Military  meteorologists  are 
particularly  interested  in  the  passive  nature  of  this  remote  sensing  capability. 

Each  GPS  transmission  between  a  satellite  vehicle  and  ground  receiver  contains  a 
total  delay  that  must  be  processed  out  of  the  navigation  reading.  This  delay  has  two 
parts:  the  ionospheric  delay  and  the  neutral  atmosphere  delay.  Using  both  the  LI  and  L2 
signals  factors  the  ionospheric  delay  out,  via  a  dispersion  relation  relating  the  two  carrier 
signals.  The  neutral  atmosphere  delay  (also  known  as  the  tropospheric  delay)  is  on  the 
order  of  2  m  and  consists  of  the  hydrostatic  delay  and  the  wet  delay  (Bevis  1992). 

Saastamoinen  (1972)  was  among  the  first  to  discover  the  relationship  between  the 
refractivity  of  the  atmosphere  and  the  satellite  signal  delays.  The  total  tropospheric  delay 
consists  of  the  sum  of  the  hydrostatic  delay  and  the  wet  delay.  The  hydrostatic  delay 
arises  from  the  dry  constituents  of  the  atmosphere.  This  part  of  the  delay  factors  in  all 
constituents  of  the  neutral  atmosphere  (to  include  nitrogen,  oxygen,  argon,  and  other 
trace  gases)  except  the  dipole  component  of  water  vapor.  These  constituents  have 
relatively  uniform  composition  in  the  troposphere.  Using  a  surface  pressure 
measurement,  the  hydrostatic  delay  is  calculated  (Bevis  1992): 
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(1) 


ZHD  = 


(2.2779  +  0.0024)  P s 
(1  -  0.00266  ■  cos(2^)  -  0.00028  •  H 


In  Equation  (1),  Ps  is  the  surface  pressure,  and  the  term  in  the  denominator  is  the 
variation  of  the  gravitational  constant  with  latitude  ((]))  and  height  (H).  With  accurate 
surface  pressure  measurements,  the  hydrostatic  delay  can  be  measured  to  better  than  1 
mm  (Businger  1996). 

The  wet  delay  arises  from  the  refractivity  of  the  water  vapor  in  the  neutral 
atmosphere.  Due  to  the  variability  of  water  vapor  in  the  troposphere,  the  wet  delay  can 
vary  from  10  mm  in  arid  regions  to  more  than  400  mm  in  more  humid  regions,  such  as 
the  tropics.  Not  only  is  there  a  significant  spatial  variability  in  wet  delay,  but  there  also 
exists  a  significant  temporal  variability. 

A  simple  relationship  exists  between  the  zenith  wet  delay  and  precipitable  water, 
as  seen  in  Equation  (2): 

PW  =  II  ■  ZWD  (2) 

where  PW  is  precipitable  water  in  a  vertical  column,  and  the  zenith  wet  delay  is  typically 
a  slant-wise  wet  delay  measurement  that  has  been  normalized  with  a  mapping  function 
that  is  roughly  related  to  the  inverse  of  the  sine  of  the  elevation  angle  (Neill  1996). 

The  wet  delay  through  the  atmosphere  is  measured  in  the  zenith  direction  with  a 
simple  integration  seen  in  (3): 


where  Pv  is  the  partial  pressure  of  water  vapor,  T  is  the  atmospheric  temperature  and  ko 
and  k3  are  empirical  refractivity  constants. 
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The  proportionality  constant  II  is  another  simple  calculation  as  seen  in  (4): 


where  Rv  is  the  gas  constant  for  water  vapor,  p  is  the  density  of  liquid  water,  Tm  is  the 
mean  temperature  through  a  vertical  layer  (which  is  further  discussed  in  the  next  section), 
and  k2  and  are  constants  related  to  the  refractivity  of  water,  obtained  empirically 
(Bevis  1994).  Therefore,  what  one  sees  is  a  basic  relationship,  which  only  requires 
knowledge  of  the  elevation  angle  of  the  satellite  vehicle  in  relation  to  the  ground 
receiver,  the  surface  pressure  to  separate  the  wet  delay  from  the  hydrostatic  delay,  and 
the  mean  temperature  through  the  vertical  layer. 

2.2.1  Calculation  of  Mean  Temperature.  The  calculation  of  the  mean 
temperature,  Tm  (in  Kelvins),  through  the  layer  has  been  simplified  even  further.  Bevis 
(1992)  determined  a  linear  relationship  between  surface  and  mean  temperatures  in  the 
continental  United  States  (CONUS)  by  comparing  the  mean  temperatures  from  8718 
radiosonde  observations  with  their  respective  surface  temperatures.  He  determined  that 
the  regression  equation  Tm  ~  70.2  K  +  0.72  Ts  would  yield  a  precipitable  water  value  with 
no  more  than  2%  error  due  to  the  regression  itself.  Note  that  this  regression  is  only  good 
for  CONUS  and  may  not  apply  in  other  geographic  regions.  Liou  (2001)  employed  the 
same  technique  in  Taiwan,  using  586  Taipei  radiosondes,  and  empirically  derived  the 
relationship  Tm  ~  1 .07TS  -  3 1 .5  K. 
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2.2.2  Calculation  of  II.  Emardson  and  Derks  (2000)  have  taken  the  regression  a 
step  further,  by  incorporating  latitude  and  time  of  year  into  the  formula  for  IT,  resulting  in 
a  relationship  unique  to  each  GPS  receiver  site: 

f  '2'jrt  \  ( 2.70 

n  =  l0~* pRvk,  +\O-*pRvk30  +  alTssin  - d-  +a2  cos  - d-  (5) 

^  365  J  ^  365  j 

In  Equation  (5),  k2  and  k3  are  the  same  constants  as  in  (4),  ai  and  a2  are  empirical 
constants  relating  the  surface  temperature  to  a  mean  temperature,  0  is  the  latitude  of  the 
receiver  site  in  radians,  and  td  is  the  Julian  day  (in  decimal  form).  To  obtain  this 
relationship,  the  authors  used  over  120,000  radiosonde  profdes  from  38  upper  air  sites 
throughout  Europe. 

Based  on  these  empirical  formulae  and  simplifications,  Bevis  (1992)  has 
determined  that  the  error  still  remains  within  4%,  which  is  within  the  tolerance  of  other 
existing  moisture  measurement  sets  (such  as  radiosondes). 

2.3  The  Fifth-Generation  Mesoscale  Model 

The  Fifth  Generation  Pennsylvania  State  University-National  Center  for 
Atmospheric  Research  Mesoscale  Model  version  3  (MM5v3)  is  the  Air  Force  Weather 
Agency’s  numerical  model  of  choice  for  its  operational  applications. 

2.3.1  Historical  Perspective.  The  model  was  first  developed  by  Richard  Anthes 
and  T.T.  Warner  at  the  Pennsylvania  State  University  (PSU)  in  1971,  and  then  was 
enhanced  through  cooperation  with  the  National  Center  for  Atmospheric  Research 
(NCAR).  Version  3  of  the  modeling  system  has  been  available  since  July  1999.  AFWA 
has  been  running  the  MM5  as  its  primary  operational  numerical  model  since  1997. 
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2.3.2  Model  Setup.  The  MM5  is  a  limited-area,  non-hydrostatic,  three- 
dimensional  model  that  employs  primitive  equations.  The  model  is  in  a  nested-grid  form 
that  calculates  output  for  a  parent  domain  as  well  as  one  or  more  sub-domains.  Grell 
(1995)  provides  additional  information  about  the  model  setup. 

The  MM5  uses  a  terrain-following  sigma  (a)  vertical  coordinate,  a  unitless  value 
defined  in  Grell  (1995)  as  (6): 

(p-pt) 

°"(PS-Pt)  (6) 

where  p  is  a  reference  pressure  based  on  user-defined  constants  and  terrain,  ps  is  the 
surface  pressure,  and  pt  is  the  specified  top  pressure.  AFWA’s  MM5  configuration  has 
41  sigma  levels. 

The  Air  Force  Weather  Agency  (AFWA)  has  taken  advantage  of  the  flexibility  of 
this  model  by  allowing  variations  in  nest  configurations  and  physics  parameterizations. 

As  of  Fall  2001,  AFWA  runs  MM5  windows  over  29  worldwide  mission  critical  theaters 
of  operations.  They  maintain  18  parent  domains,  from  which  1 1  inner  nest  windows  are 
derived  (Applequist  2001,  personal  correspondence).  In  addition,  the  MM5  has  physics 
packages  that  AFWA  has  the  option  to  configure  to  best  take  advantage  of  a  particular 
theater  of  interest.  Theaters  that  will  be  addressed  in  this  research  all  have  the  same 
physics  packages,  as  outlined  in  Table  1  (Craig  2000). 

AFWA  MM5’s  parent  domains  each  have  45  km  grid  resolution,  while  the  inner 
nest  domains  have  spacings  that  range  from  15  km  to  1.67  km.  Parent  domains  are 
initialized  and  run  twice  per  day,  running  72-hour  forecasts  in  3-hour  intervals.  The  15 
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km  inner  nest,  the  domain  used  for  this  research,  initializes  two  times  per  day,  6  hours 
after  the  parent  domain’s  run.  Inner  nests  produce  48-hour  forecasts,  also  in  3-hour 
intervals. 


Table  1.  AFWA  MM5  Physics  Packages.  Adapted  from  Craig  (2001). 


Parameter 

Scheme 

Atmospheric  Radiation 

Dudhia  Longwave  and  Shortwave 

Cumulus  Parameterization 

Grell  Convective 

Explicit  Schemes 

Reisner  Mixed  Phase 

Planetary  Boundary  Layer 

MRF  PBL 

Soil  Model 

Multi-Layer  Thermal  Diffusion 

2.3.3  Model  Initialization.  Until  January  2001,  the  MM5  used  synoptic 
background  fields  based  on  the  Aviation  Model  (AVN)  or  the  Navy  Operational  Global 
Atmospheric  Prediction  System  (NOGAPS).  AFWA’s  MM5  now  initializes  its  parent 
domains  using  a  Mesoscale  Data  Assimilation  System  /  Multivariate  Optimal 
Interpolation  (MDAS/MVOI)  scheme.  The  inner  nests  are  not  initialized  in  this  way; 
instead  it  uses  the  parent  windows.  With  MDAS/MVOI,  the  model  can  now  use  its  own 
forecast  background  fields,  combined  with  global  analyses,  to  generate  accurate  analysis 
fields  that  adapted  well  to  the  various  45  km  resolution  parent  domain  locations  (Ritz  et 
al.  2001).  With  MDAS/MVOI,  GPS-derived  PW  is  unable  to  be  of  temporal  value  to  the 
model.  A  more  temporally  dynamic  assimilation  scheme  is  required  to  better  take 
advantage  of  the  temporal  variability  PW  values,  such  as  3DVAR,  explained  in  the  next 
section. 
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2.3.5  3DVAR  Assimilation  Scheme.  By  summer  2002,  AFWA  is  expected  to 
have  transitioned  all  of  its  parent  domain  initializations  to  the  3 -Dimensional  Variational 
Analysis  (3DVAR)  system.  3DVAR  will  accommodate  virtually  all  of  the  observation 
types  that  MDAS/MVOI  currently  employs,  along  with  some  new  types,  to  include  wind 
profiler  data.  It  is  expected  that  GPS-derived  precipitable  water  will  be  among  the  data 
types  accommodated  by  3DVAR.  Parallelization  of  the  data  assimilation  and 
interpolation  techniques  over  several  processors  will  also  make  incorporating  GPS- 
derived  PW  easier  (Ritz  2001). 

2.4  Using  GPS  Meteorology  to  Validate  and  Improve  Forecast  Models 

Studies  have  already  shown  how  GPS-derived  precipitable  water  observations 
compare  with  numerical  forecast  model  output.  Some  studies  assimilated  the  PW  values 
into  the  model  initialization,  while  others  simply  conducted  an  independent  data 
comparison,  similar  to  this  research.  For  further  details  on  these  studies,  the  reader  is 
directed  to  the  references  cited  in  the  text.  Summaries  of  a  selection  of  these  studies 
follow. 


2.4.1  High  Resolution  Limited  Area  Model  (HIRLAM).  The  FIIRL  AM  model  is 
a  regional  NWP  system  developed  by  the  weather  services  of  the  Nordic  countries,  along 
with  Ireland,  Holland,  and  Spain. 

Yang  et  al.  (1999)  compared  GPS  precipitable  water  data  with  a  0.21°  resolution 
HIRLAM  configuration  similar  to  the  operational  version  at  the  Danish  Meteorological 
Institute.  Comparisons  of  the  6,  12,  and  30-hour  forecasts  of  precipitable  water  with  the 
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concurrent  GPS  precipitable  water  values  at  25  sites  in  Sweden  and  Finland  were 
conducted.  This  study  was  performed  between  August  and  November  1995  and  over 
1 1,000  observations  were  compared. 

Results  of  the  comparison  between  the  GPS  PW  values  and  the  HIRLAM  analysis 
were  very  optimistic.  Correlations  ranged  from  0.91  to  0.96,  averaging  0.94,  and  RMSE 
ranged  between  1.9  and  3.4  mm,  with  a  mean  value  of  2.4  mm,  approximately  18%  of  the 
mean  PW  value.  For  the  6,  12,  and  30-hour  forecasts,  the  correlations  were  0.94,  0.93 
and  0.93,  respectively,  and  the  RMSEs  were  2.4,  2.5,  and  2.6  mm,  respectively. 

In  Spain,  Cucurull  et  al.  (2000)  employed  the  HIRLAM  model  to  compare 
analysis  and  forecast  precipitable  water  values  with  GPS-derived  PW  values  at  five  GPS 
sites  in  the  Madrid  Sierra  region  of  central  Spain.  The  case  was  during  2-15  December 
1996  and  involved  two  frontal  passages.  The  HIRLAM  analyses,  when  compared  with 
the  GPS-derived  PW  values,  resulted  in  a  model  moist  bias  of  0.2  mm  and  an  RMS 
difference  of  2.1  mm.  The  24-hour  HIRLAM  forecast  resulted  in  a  bias  of -1.2  mm  and 
an  RMSE  of  3  mm.  The  higher  values  were  expected  of  the  longer  forecast  integration 
time. 

Finally,  Lenderink  and  Meijgaard  (2001)  compared  the  performance  of  a 
modified  HIRLAM  model,  the  HIRHAM4,  with  the  Nordic  GPS  network.  The 
HIRHAM4  is  a  high-resolution  (0.167°)  version  of  HIRLAM  with  a  physics  package 
known  as  ECHAM4.  For  comparison,  the  authors  also  modified  the  ECHAM4  package 
with  revised  cloud  and  turbulence  schemes.  At  the  same  time,  both  the  HIRLAM  and 
European  Centre  for  Medium-Range  Weather  Forecasting  (ECMWF)  models’  analyses 
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were  used  in  the  HIRHAM4  to  assess  which  would  handle  the  high-frequency  variation 
of  GPS-derived  integrated  water  vapor  (IWV).  This  setup  was  run  for  three  frontal 
passages  from  28  August  to  5  September  1995. 

The  study  concluded  that,  in  the  first  24  hours  of  forecast,  the  HIRLAM  analyses 
produced  a  more  accurate  depiction  of  the  high  variability  of  the  IWV  fields,  most  likely 
due  to  the  higher  resolution  (0.4°)  of  the  HIRLAM  grid  compared  to  the  1.5°  ECMWF. 
After  24  hours,  the  ECMWF  was  superior.  Regarding  the  comparison  between  the  two 
model  physics  packages,  the  revised  physics  package  better  captured  the  maxima  and 
minima  of  IWV  during  frontal  passages,  as  well  as  the  timing  of  these  peak  values. 

2.4.2  Rapid  Update  Cycle  (RUC).  Wolfe  and  Gutman  (2000)  have  pioneered 
American  efforts  to  bring  GPS  meteorology  into  operational  forecasting.  In  their  2000 
study,  they  assimilated  GPS-derived  PW  into  the  Mesoscale  Analysis  and  Prediction 
System  (MAPS),  which  is  NOAA’s  research  version  of  the  RUC  model.  The  RUC  is  a 
high  frequency,  state-of-the-art  analysis  and  forecast  system  run  by  the  National  Centers 
for  Environmental  Prediction  (NCEP).  Most  operational  RUC  forecasts  are  run  on  40- 
km  and  20-km  resolution  grids  and  seldom  exceed  12-hour  integration  times.  In  this 
study,  GPS-IPW  values  were  assimilated  into  the  RUC  analyses  every  three  hours  from 
20-29  June  1997  using  optimal  interpolation. 

Output  was  assessed  for  the  Purcell,  OK  GPS-receiver  site.  The  analyses  showed 
a  mean  bias  of  1.8  mm  (RUC  had  more  moisture)  and  an  error  range  of  5.5  to  -6.9  mm. 
Only  one  12-hour  forecast  was  evaluated  in  this  study,  and  the  preliminary  results 
showed  that  GPS-IPW  in  the  model  better  captured  variations  in  convective  precipitation. 
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Smith  et  al.  (2000)  provided  more  detail  in  the  same  ongoing  RUC  assimilation 
study.  In  this  case,  GPS-IPW  observations  were  assimilated  every  3  hours  into  a  60-km 
resolution,  25-sigma  level  RUC  window  over  the  central  United  States.  Every  three 
hours,  a  new  analysis  was  produced,  using  the  previous  3-hour  forecast  as  the 
background  field.  Parallel  runs  of  the  RUC  with  and  without  the  GPS-IPW  have  been 
ongoing  since  November  1997. 

The  GPS  data  provided  valuable  information  at  a  temporal  and  spatial  resolution 
that  cannot  be  obtained  through  a  radiosonde  network.  Because  GPS  data  is  available 
approximately  every  half  hour  in  the  American  GPS-MET  network,  it  was  possible  to 
ingest  the  GPS  values  at  every  analysis  time,  while  the  radiosonde  data  is  only  available 
every  12  hours.  In  the  case  presented  in  Smith  et  al.  (2000),  from  16  to  17  April  1998,  a 
cold  front  crossed  eastern  Texas.  The  GPS  data  moistened  the  3-hour  forecast  of  relative 
humidity  fields  by  14%  ahead  of  the  front,  and  dried  out  the  fields  by  23%  behind.  This 
resulted  in  a  1%  improvement  of  the  850mb  RH  and  a  2%  improvement  of  the  500  mb 
RH. 

Smith  et  al.  (2000)  made  two  other  observations  that  must  be  considered  for 
future  work  on  assimilation  of  GPS  data  into  NWP.  First,  the  GPS  observations 
themselves  must  maintain  an  accuracy  of  at  least  1.5  mm  to  be  considered  a  value-added 
data  source.  This  value  has  to  include  errors  that  could  evolve  from  inaccuracies  in  orbit, 
temperature  and  pressure  measurements,  and  post-processing.  It  was  also  concluded  that 
the  high  variability  of  IPW  limits  the  value  of  the  data  to  making  improvements  in  the 
short-term,  especially  in  the  12-hour  forecast  timeframe. 
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Gutman  and  Benjamin  (2001)  provided  an  update  to  the  same  experiment,  this 
time  with  a  more  populated  CONUS  GPS-MET  network.  When  Smith  et  al.  (2000) 
started  their  work,  there  were  only  18  stations.  By  late  1999  the  number  had  jumped  to 
58,  including  a  number  of  sites  on  coastlines,  where  moisture  data  are  often  the  most 
variable.  Now  forecast  RH  values  at  both  850  mb  and  700  mb  were  improved  by  an 
average  of  4.5%.  At  one  model  run,  the  3-hour  forecast  was  improved  by  as  much  as 
40% ! 

Other  conclusions  found  by  Gutman  and  Benjamin  (2001)  involve  the  required 
accuracy  and  timeliness  of  the  GPS  data.  In  order  for  the  GPS  data  to  be  of  value  to  an 
NWP  model,  it  must  be  measured  at  a  higher  accuracy  than  the  model’s  error  budget. 

The  current  convention  is  for  models  to  analyze  the  precipitable  water  fields  to  within  3 
mm  accuracy.  The  Department  of  Energy  has  conducted  a  number  of  Water  Vapor 
Intensive  Observing  Periods  (WVIOPs),  which  compares  precipitable  water  from  6 
different  sources  at  a  facility  near  Lamont,  OK.  The  results  from  this  period  show  that 
GPS-derived  precipitable  water  has  an  accuracy  of  about  1  mm,  which  is  well  within  the 
tolerances  required  for  a  valuable  data  source  for  NWP.  Concerning  the  timeliness, 
observations  for  initialization  into  numerical  weather  models  is  considered  “real-time”  if 
it  can  be  ingested  in  the  current  assimilation  cycle.  This  timeline  is  unique  to  each 
model,  and  the  RUC  requires  20-30  minutes  before  an  observation  is  considered  late. 
Currently,  for  quick  post-processing,  a  “rapid  orbit”  calculation  is  required  in  the 
processing  software.  Scripps  Institution  of  Oceanography  has  the  capability  to  make 
such  orbit  calculations  with  its  processing  software  in  24  hours  (compared  to  1-2  weeks), 
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and  has  done  so  to  well  within  1  mm  accuracy,  which  adheres  to  the  tolerances  for 
assimilation  into  numerical  models. 

2.4.3  PSU/NCAR  MM5.  De  Pondeca  and  Zou  (2001)  reported  on  an  assimilation 
of  GPS  total  zenith  delay  observations  into  the  MM5  for  a  precipitation  forecast  in 
southern  California  during  an  El  Nino  event.  The  data  was  ingested,  using  a  4DVAR 
assimilation  scheme,  into  a  6-km  resolution  domain  with  20  sigma  levels.  A  domain 
based  on  the  54-km  NCEP  reanalysis  over  the  western  United  States  was  the  parent  to  a 
6-km  nested  grid  that  served  as  an  initial  condition  in  the  4-DVAR  assimilation  scheme. 
After  two  hours  worth  of  observation  ingest,  the  scheme  required  a  12-hour  spinup, 
necessary  to  acquire  the  dynamic  stability  and  damping  of  smaller  scale  gravity  waves. 

De  Pondeca  and  Zou  (2001)  compared  total  zenith  delays  from  MM5  output  that 
was  run  both  with  and  without  the  GPS  data.  The  results  were  remarkable.  First,  the  bias 
between  the  model  run  and  the  GPS  observations  was  reduced  by  more  than  90%  when 
the  GPS  data  was  assimilated.  Secondly,  the  precipitation  forecasts  were  timelier  and 
more  accurate,  by  an  average  of  33.15%. 

Cucurull  et  al.  (2001)  also  performed  a  4DVAR  assimilation  of  simulated  GPS- 
derived  PW  into  a  very  fine  scale  MM5  over  Spain.  Their  grid  resolutions  were  6  km 
and  2  km,  with  5  minute  and  30  second  terrain  resolution,  respectively.  In  this  study, 
simulated  values  of  PW  were  assimilated  using  a  4DVAR  scheme.  First  the  MM5  was 
run  over  the  period  of  interest  and  PW  values  were  estimated  at  each  grid  point  at  30 
minute  intervals.  This  created  an  “idealized”  fictitious  GPS  network.  This  information 
was  then  re-introduced  to  the  model  using  variational  assimilation. 
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Results  of  this  experiment  showed  the  model’s  high  sensitivity  to  the  PW 
observations.  However,  no  numeric  results  were  available  due  to  the  paper’s  emphasis 
on  assimilation  of  ZTD  into  the  model. 

2.4.4  Deutche  Wetterdienst  (DWD)  Models.  Kopken  (2001)  employed  three 
models  derived  from  the  DWD’s  limited  area  forecast  and  analysis  system:  the  Europa 
Model  (1/2°  horizontal  resolution  and  20  sigma  levels),  the  Deutschland  Model  (1/8° 
horizontal  resolution  and  30  sigma  levels),  and  the  BALTEX  Model  (1/6°  horizontal 
resolution  and  31  sigma  levels). 

Kopken’s  work  was  conducted  with  the  same  Nordic  GPS  network  as  Yang 
(1999)  and  Lenderink  and  Meijgaard  (2001).  The  study  was  conducted  over  August  - 
October  1995.  The  GPS  data  was  taken  in  30  minute  increments  and  was  not  assimilated 
into  the  models. 

The  results  of  Kopken’s  study  were  promising,  with  correlations  between  the 
BALTEX  model  and  the  GPS  data  near  90%,  and  bias  of  less  than  3  mm.  The  model 
positive  bias  was  consistent  throughout  the  experiment  period  at  virtually  all  GPS 
receiver  sites,  and  for  all  three  of  the  models.  Such  a  bias  was  also  seen  in  the  HIRLAM 
model.  To  further  investigate  this  bias,  comparisons  between  the  GPS  data  and 
radiosonde  data  were  also  performed.  Kopken’s  results  for  six  stations  in  Sweden  and 
Finland  indicated  the  GPS  possessing  a  slight  dry  bias  of  about  1.3  mm.  This  could 
indicate  that  the  DWD  models  have  an  overall  moist  bias  of  approximately  1.5  mm. 

2.4.5  Swedish  Meteorological  and  Hydrological  Institute  Model.  A  Central 
European  GPS  meteorology  network  of  15  sites  was  analyzed  in  Borbas  (1998).  A 
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numerical  model  developed  by  the  Swedish  Meteorological  and  Hydrological  Institute 
was  used  for  comparison.  This  model  was  a  primitive  equation  model  with  a  90-km 
horizontal  resolution  and  12-sigma  levels. 

Comparisons  were  made  by  linearly  interpolating  the  four  nearest  gridpoints  to 
GPS-receiver  sites  in  Gennany,  Switzerland  and  Poland.  The  GPS  data  were  processed 
using  two  different  processing  schemes,  one  at  the  International  GPS  Service  at  the 
University  of  Bern,  Switzerland,  and  the  other  at  the  Institute  of  Space  Research, 
Department  of  Satellite  Geodesy  in  Graz,  Austria. 

When  compared  with  the  NWP,  the  GPS  data  was  again  consistently  drier  than 
the  model  output,  with  a  5.5  mm  RMSE  with  the  Bern  processing  software,  and  a  6.3  mm 
RMSE  with  the  Graz  processing  software. 

2.4.6  Summary.  Overall,  this  sample  of  studies  involving  GPS-derived 
precipitable  water  with  NWP  has  shown  the  GPS  data’s  reliability,  along  with  its 
excellent  spatial  and  temporal  resolution.  For  these  studies,  GPS-derived  PW  was  clearly 
a  value-added  data  source.  Independent  data  comparisons  showed  how  well  GPS 
compares  with  radiosonde  data,  and  could  reduce  consistent  biases  in  many  NWP 
models.  Also,  assimilation  studies  have  proven  on  numerous  occasions  how  moisture- 
related  variables  are  more  accurate  when  GPS  data  are  included. 
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III.  Methodology 


3.1  Data  Collection 

3.1.1  GPS-Meteorology  Data.  The  National  Oceanic  and  Atmospheric 
Administration  Forecast  Systems  Laboratory  (NOAA/FSL)  controls  the  American 
network  of  GPS  Precipitable  Water  receivers.  Their  network  of  over  50  sites  in  the 
CONUS  and  four  sites  in  Alaska  produces  precipitable  water  readings  every  30  minutes 
and  posts  a  comprehensive  output  fde  to  an  FTP  site  for  public  viewing  and  download. 
Table  2  is  an  example  of  the  downloaded  data  from  the  NOAA/FSL  database.  Figure  4 
shows  NOAA’s  GPS  Meteorology  network  as  of  May  2001.  See  Appendix  A  for  terrain, 
network,  and  gridding  details  for  each  GPS  site. 

The  NOAA/FSL  GPS-MET  website  contains  the  geodesy  and  hardware 
specifications  for  the  sites.  Most  of  the  sensors  are  either  Trimble  4000  SSI  or  Ashtech 
LP  Z-XII3  receivers,  and  the  data  is  processed  with  the  University  of  Hawaii/Scripps 
Institute  for  Oceanography  GAMIT  software  suite  using  predicted  orbit  information. 


Table  2.  Sample  GPS-MET  Data  from  Bartlett,  NH  for  6  July  2001 


ID 

Year 

Julian 

Date 

IPW 

(cm) 

Press 

(mb) 

Temp  (C) 

RH  (%) 

Total 
Delay  (m) 

Wet  Delay 
(m) 

Hydro 
Delay  (m) 

Mean  Temp 
(K) 

n  (cm) 

BARN 

2001 

187 . 010 

2 . 512 

986.73 

19.42 

84 . 7 

2.4035 

0.1567 

2.2468 

280.85 

6.239 

BARN 

2001 

187.031 

2.381 

986.95 

18 . 17 

89.4 

2.3963 

0.149 

2.2473 

279.95 

6.259 

BARN 

2001 

187 . 052 

2.385 

987.25 

17.63 

89.7 

2.3974 

0.1495 

2.2479 

279.562 

6.268 

BARN 

2001 

187 . 073 

2.617 

987.65 

17 . 4 

89.3 

2.413 

0.1641 

2.2489 

279.396 

6.271 

BARN 

2001 

187 . 094 

2.62 

987.88 

17.28 

87 

2.4138 

0.1644 

2.2494 

279.31 

6.273 

BARN 

2001 

187 .115 

2.539 

987.82 

17.02 

85.2 

2 . 4087 

0.1594 

2.2492 

279.122 

6.277 
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Figure  4.  The  American  GPS  Precipitable  Water  Receiver  Network  as  of  31  May  2001.  Courtesy  of 

NOAA/FSL. 

3.1.2  MM5  Data.  The  MM5  data  for  the  CONUS  and  Alaska  15  km  grids  were 
obtained  from  AFWA.  The  GRIB  output  was  downloaded  daily  from  06  July  2001 
through  3 1  October  200 1 .  Only  four  parameters  needed  to  be  stripped  from  the  GRIB 
files:  longitude  (LUN),  latitude  (LOT),  terrain  height  (TERHGT),  and  precipitable  water 
(PWAT).  The  first  three  parameters  are  necessary  for  properly  placing  the  GPS  data  on 
the  MM5  grid.  Processing  of  the  PWAT  data  will  be  discussed  later  in  this  chapter. 


3.1.3  RAOB  Data.  RAOB  sites  were  chosen  based  on  their  proximity  to  GPS- 
receiver  sites.  There  was  a  challenge  of  finding  collocated  sites  since  the  NOAA/FSL- 
controlled  GPS  network  is  not  concurrent  with  established  WMO  weather  observation 
sites.  Using  guidance  from  Kopken  (2001),  the  estimated  range  of  atmosphere  included 
in  a  GPS-derived  PW  value  has  40  km  radius.  Therefore,  only  upper  air  sites  within  45 
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km  of  GPS  sites  were  chosen  for  comparison.  However,  Springfield,  MO  (SGF)’s 
RAOB  site  was  also  considered,  due  to  its  location  in  the  Tornado  Alley  region  of  the 
country,  despite  it  being  nearly  70  km  from  the  nearest  GPS  site,  Conway,  MO 
(CNWM). 

The  radiosonde-based  PW  values  were  downloaded  from  the  GPS-MET  website 
(http://www.gpsmet.noaa.gov).  This  website  provides  radiosonde  output  in  an  easy-to- 
process  fonnat.  Because  this  data  was  pre-formatted,  reading  it  into  FORTRAN 
programs  was  simple  and  requires  no  further  discussion  in  this  section. 

3.2  Sources  of  Error 

Prior  to  explaining  the  data  analysis  process,  it  is  important  to  address  the  sources 
of  error  faced  in  working  with  GPS  data  in  concert  with  MM5  and  RAOB  data.  The 
following  is  a  discussion  of  possible  sources  of  error.  Further  details  are  available  in 
Feng  (1998). 

3.2.1  Make  and  model  of  GPS  equipment.  This  is  not  an  explicit  source  of  error 
that  has  been  measured,  but  the  varying  makes  and  models  of  GPS  equipment  provides  a 
lack  of  consistency  in  how  a  GPS-MET  sample  was  taken.  Table  3  shows  a 
representation  of  the  makes  and  models  of  GPS  receiver  and  antenna  equipment,  in  no 
particular  order. 
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Table  3.  Representation  of  Makes  and  Models  of  GPS  Receivers 


Receiver  Models 

Description 

Trimble  4000  SSE 

Dual  frequency  P-code  on  LI  and  L2 

Trimble  4000  SSI 

Dual  frequency  P-code  on  LI  and  L2 

Ashtech  LP  Z-XII3 

12  Channel,  L1/L2,  P1/P2  w/  continuous 
reference  station  capability 

Ashtech  LP  Z 1 2 

12  Channel,  L1/L2 

3.2.2  Antenna  configuration  and  height.  The  type  of  antenna  is  a  bonafide 
source  of  error  in  processing  GPS-MET  data.  There  are  two  types  of  GPS  antennas  well 
known  in  the  navigation  world:  the  choke  ring  and  the  fixed  groundplane.  Many  older 
antenna  models  still  have  a  fixed  groundplane  configuration,  and  this  could  be  a  source 
of  error  in  GPS  calculations.  The  choke  ring  antenna  is  the  International  GPS  Service 
(IGS)  standard  for  computing  phase  center  corrections  (Feng  1998).  Table  4  provides 
information  about  the  various  antennas  involved  in  this  study. 


Table  4.  Representation  of  Makes  and  Models  of  GPS  Antennas 


Antenna  Models 

Shape 

Trimble  33429 

Fixed  Groundplane 

Trimble  29659 

Dome  Margolin  Choke  Ring 

Trimble  22020 

Fixed  Groundplane 

Trimble  14532 

Fixed  Groundplane 

Trimble  23903 

Fixed  Groundplane 

Ashtech  700829  "Whopper" 

Fixed  Groundplane 

3.2.3  Elevation  differences 

3.2.3. 1  Differences  between  GPS  site  elevation  and  MM 5  TERHGT 
value.  A  significant  source  of  error  in  the  comparisons  between  GPS  and  MM5  PW 
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values  is  the  difference  in  elevation  at  each  GPS  site.  The  model  height  of  the  GPS  site 
was  calculated  by  linear  interpolation  of  the  TERHGT  value  for  four  surrounding  grid 
points.  This  was  compared  with  the  established  height  of  the  GPS  receiver,  provided  by 
the  network  administrators.  No  adjustments  were  made  to  correct  for  the  differences  in 
terrain  in  this  study.  Elevation  residuals  are  shown  in  the  location  data  in  Appendix  A. 

3.23.2  Differences  between  GPS  site  elevation  and  RAOB  site.  Like  the 
MM5  elevations,  the  differences  between  the  GPS  sites  and  their  nearest  RAOB  locations 
can  be  significant.  This  elevation  difference  can  be  corrected  using  assumptions  of 
constant  relative  humidity  and  a  typical  lapse  rate,  but  the  RAOB  sites  used  in  this  study 
had  similar  enough  elevations  that  such  differences  were  negligible.  The  elevation 
residuals  between  the  GPS  and  RAOB  locations  are  shown  with  the  location  data  in 
Appendix  A. 

3.2.4  Horizontal  differences  between  GPS  site  and  RAOB  site  locations.  As 
discussed  in  Section  3.1.3,  only  RAOB  sites  that  were  within  45  km  of  the  GPS  site  were 
chosen  for  this  study  (plus  Springfield,  MO,  as  explained  in  Section  3.1.3).  Due  to  the 
setup  of  the  GPS  network,  this  resulted  in  very  few  RAOB  sites  being  available.  The 
horizontal  differences  between  the  GPS  sites  and  RAOB  sites  are  of  particular  interest 
due  to  several  of  the  sites  being  near  coastlines.  When  a  RAOB  sites  is  near  a  coastline, 
there  is  a  chance  of  the  balloon  drifting  over  the  ocean  and  being  exposed  to  increased 
moisture  compared  to  an  inland  GPS  site.  These  distance  differences  are  shown  in 
Appendix  B. 
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3.2.5  Orbit  calculations.  The  orbit  calculation  methods  are  another  source  of 


error  in  GPS-MET  parameter  calculations.  Knowledge  of  ephemeris  data  is  essential  to 
calculate  ZHD  and  ZWD.  There  are  5  variations  on  the  type  of  orbit  information, 
outlined  in  Table  5. 


Table  5.  Comparison  of  GPS  Orbit  Calculations  Available  in  GPS-MET  Processing  (NASA  2001). 


GPS  Orbit  Calculation 

Accuracy 

Latency 

Update  Frequency 

Broadcast 

~260  cm 

real  time 

— 

Scripps  Hourly 

~20  cm 

real  time 

hourly 

Predicted  (Ultra  Rapid) 

~25  cm 

real  time 

twice  daily 

Rapid 

~  5  cm 

1 7  hours 

daily 

Final 

<  5  cm 

~  13  days 

weekly 

The  NOAA/FSL  GPS  network  uses  the  Scripps  Hourly  orbit  product,  which 
provides  the  most  up-to-date,  real-time  orbit  information  for  operational  processing  of 
GPS-MET  data.  Their  standard  for  accuracy  is  25  cm,  so  the  Scripps  product  is  within 
that  tolerance. 


3.2.6  Processing  software.  This  potential  for  error  arises  from  the  varying 
methods  of  processing  the  data.  There  are  several  software  suites  available  for 
calculating  tropospheric,  hydrostatic  and  wet  delays,  from  which  PW  is  extracted.  A  list 
of  the  most  widely  used  programs  is  listed  in  Table  6.  A  study  was  conducted  comparing 
the  GPS-MET  data  from  these  three  software  packages  with  varying  orbital  calculations. 
It  was  concluded  that  BERNESE  and  GAMIT  had  comparable  accuracies,  and  that  other 
factors  besides  software  accuracy  can  be  taken  into  account  to  decide  on  which  software 
package  is  better  (Department  of  Commerce  1995).  The  NOAA/FSL  network  employs 
the  GAMIT  software  suite. 
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Table  6.  Available  GPS  Processing  Software 


Software 

Developer 

Massachusetts  Institute  of 

GAMIT 

Technology/Scripps  Institute  of 

Oceanography 

BERNESE 

University  of  Bern 

PAGES 

National  Geodetic  Survey 

3.2. 7  Empirical  estimates  of  parameters  in  GPS-MET  calculations.  Many 
calculations  in  processing  GPS-MET  parameters  require  constants  of  proportionality. 
These  constants  were  empirically  defined  with  studies  involving  thousands  of 
radiosondes. 

The  mean  temperature  for  II  in  Equation  (4)  is  routinely  calculated  for  CONUS 
and  Alaska  using  Bevis’  (1992)  empirical  correlation  based  on  8718  radiosonde 
calculations  over  2  years.  Other  studies  have  been  conducted  in  Europe  and  Taiwan  that 
derive  other  mean  temperature  correlations.  These  correlations  are  sufficient  for 
meteorological  use  of  GPS,  and  their  relative  error  is  less  than  1%.  Nonetheless,  this  is 
still  a  contribution  to  the  error  budget. 

The  refractivity  constants,  k2  and  k3,  in  Equations  (3)  and  (4)  also  are  empirically 
defined.  Bevis  et  al.  (1994)  provides  historical  commentary  on  their  derivations.  Bevis 
et  al.  (1994)  also  derived  his  own  values  for  the  refractivity  constants  and  assumed  them 
to  be  within  2  standard  deviations  of  the  true  values. 
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Bevis  et  al.  (1994)  concluded  that  the  error  in  mean  temperature  is  much  greater 
than  that  of  the  refractivity  constants,  and  that  most  of  the  error  in  the  If  calculation  is 
due  to  the  mean  temperature. 

3.2.8  Differences  in  PW  calculation  methods  between  GPS,  RAOB  and  MM5. 
Another  significant  source  of  error  is  the  differences  in  how  PW  is  calculated  among  the 
three  data  sources. 

The  GPS  PW  is  calculated  using  the  equations  outlined  in  Chapter  II.  Note  that 
there  is  no  reference  to  typical  humidity  parameters,  such  as  mixing  ratio,  dew  point  or 
specific  humidity. 

The  RAOB  PW  is  calculated  using  a  NOAA  algorithm  and  it  integrates  mixing 
ratio  over  all  pressure  levels.  Mixing  ratio  is  defined  as  the  ratio  of  water  vapor  to  dry  air 
(Glickman  2000).  If  the  sounding  from  which  mixing  ratio  is  being  calculated  runs  out 
of  data  before  encountering  the  highest  possible  level,  then  those  levels  are  simply  left 
off;  if  the  top  level  is  less  than  5  km  elevation,  the  sounding  is  thrown  out. 

MM5  PW  is  calculated  by  integrating  specific  humidity  over  all  pressure  levels. 
For  all  intents  and  purposes,  it  is  acceptable  to  interchange  specific  humidity  and  mixing 
ratio  (Glickman  2000).  A  typical  mid-latitude  mixing  ratio  value  varies  from  a  specific 
humidity  value  by  not  more  than  0.1%.  It  has  been  observed  that  some  operational 
versions  of  the  MM5  may  interchange  specific  humidity  and  mixing  ratio  in  calculations 
(Swanson  2001). 
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3.3  Coding  of  Processing  Programs 

3.3.1  Overview.  A  number  of  variables  required  custom  procedures  for  each  of 
the  theaters  processed.  The  following  steps  needed  to  be  completed:  (1)  extract  relevant 
information  from  GPS,  MM5  and  RAOB  input  data  and  read  the  data  from  the  various 
sources  into  FORTRAN  arrays,  (2)  perform  linear  interpolation  of  MM5  data  to  GPS 
sites,  (3)  write  out  arrays  of  GPS  data  with  RAOB  sites,  (4)  write  out  the  GPS,  MM5  and 
RAOB  values  by  domain  and  by  location,  (5)  calculate  comparative  statistics  and  write 
them  out  to  delimited  text  files.  These  text  files  were  then  imported  into  Microsoft  Excel 
for  statistical  processing.  Now  each  step  will  be  reviewed  in  more  detail. 

3.3.2  Extract  Relevant  Information.  Each  of  the  three  data  sources  (GPS,  MM5 
and  RAOB)  required  unique  programs  to  extract  the  relevant  information.  The  GPS  data 
came  from  the  FSL  FTP  site  grouped  according  to  location.  First,  appending  all 
locations’  files  created  a  large  file.  Then  a  program  was  developed  which  brought  in  the 
GPS  output  file  and  read  the  columns  into  arrays  according  to  data  type  (i.e.  year,  id, 
Julian  date).  A  second  pass  was  then  performed  to  conduct  several  tasks  at  once.  It  first 
threw  out  the  lines  with  missing  PW  values.  Then  it  searched  through  the  Julian  date 
arrays  to  strip  out  only  those  values  that  contained  a  particular  DTG.  Those  lines  were 
written  to  a  new  formatted  file  named  after  the  Julian  DTG. 

The  MM5  output  required  more  work  than  the  GPS  and  RAOB  data,  due  to  its 
two-dimensional  nature  and  binary  fonnat.  The  PWAT  parameter  that  was  stripped  from 
each  GRIB  file  had  to  be  converted  to  a  binary  fonnat  and  then  read  into  FORTRAN 
arrays. 
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The  RAOB  data  was  relatively  easy  to  work  with.  The  files  were  downloaded 
from  the  NOAA/FSL  website  in  a  long  string  of  fonnatted  soundings  with  no  definitive 
breaks.  To  divide  the  data  into  separate  soundings,  an  IDL  routine  was  employed.  The 
end  result  was  one  file  for  each  of  the  soundings,  named  according  to  sounding  location 
and  DTG. 

3.3.3  Perform  linear  interpolation  of  MM5  data  to  GPS  sites.  Each  GPS  site 
had  a  grid  coordinate  corresponding  to  the  MM5  grid  position  calculated,  based  on  a 
FORTRAN  subroutine  from  AFWA.  The  subroutine  brought  in  parameters  describing 
the  MM5  grid,  along  with  an  array  of  latitudes  and  longitudes  of  the  GPS  sites,  and  wrote 
out  an  array  of  IX/JX  positions.  The  interpolation  program  reads  in  the  MM5  GRIB  data 
and  linearly  interpolates  the  values  of  the  sixteen  surrounding  grid  points  to  the  GPS 
receiver  location’s  IX/JX  position. 

Sixteen  grid  points,  rather  than  four,  were  chosen  due  to  the  horizontal  extent  of  a 
GPS-derived  PW  observation.  Figure  5  shows  the  trigonometric  relationship  of  the 
horizontal  expanse  of  an  averaged  GPS-derived  PW  reading.  The  conditions  assume  a  7° 
elevation  angle  (which  is  the  elevation  cutoff  for  the  NOAA/FSL  network)  and  that  98% 
of  the  column  water  vapor  resides  in  the  lowest  5  km  of  the  atmosphere.  This  results  in  a 
horizontal  coverage  of  approximately  5200  km“. 


34 


Figure  5.  Area  of  Influence  of  a  GPS-Derived  Precipitable  Water  Reading.  Diagram  not  to  scale. 

In  a  15  km  resolution  model,  the  horizontal  expanse  of  sixteen  grid  points  will 
cover  2025  km  .  Figure  6  illustrates  this.  Even  though  the  coverage  areas  aren’t  exactly 
the  same,  choosing  an  additional  ring  of  grid  points  would  have  resulted  in  an  area  much 
larger  than  that  of  the  GPS  observation.  The  7°  cutoff  will  result  in  a  larger  area  of 
influence,  but  expanding  the  MM5  grid  points  any  farther  would  cause  negligible 
differences  in  PWAT  values,  due  to  the  nature  of  the  interpolation  scheme. 


3  x  15000  m  =  45000  m 


Figure  6.  Area  of  Influence  in  MM5  Grid.  The  GPS  site  is  positioned  somewhere  in  the  center  box. 

3.3.4  Write  out  arrays  of  GPS  data  with  RAOB  sites.  To  calculate  precipitable 
water  from  each  of  the  RAOB  soundings  another  FORTRAN  program  was  required.  The 
foundation  for  this  program  came  from  Thomas  Schlatter  and  Donald  Baker  in  the 
PROFS  Program  Office,  NOAA  Environmental  Research  Laboratories,  Boulder, 
Colorado.  Schlatter  and  Baker  developed  a  suite  of  FORTRAN  algorithms  in  1981  to 
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calculate  moisture  parameters.  This  suite  is  the  standard  throughout  NOAA  and  the 
National  Weather  Service.  For  the  precipitable  water  algorithm,  the  method  of  choice 
was  to  integrate  dimensionless  mixing  ratios  through  the  pressure  levels. 

Each  sounding  was  run  through  the  precipitable  water  algorithm  and  the  output 
was  grouped  by  location  into  files.  An  example  of  one  of  these  files  is  in  Table  7. 


Table  7.  Sample  RAOB-Based  Precipitable  Water  for  Charleston,  SC 


ID 

MO 

DY 

HR 

PW 

CHS 

7 

6 

0 

5.2679 

CHS 

7 

6 

12 

4.7164 

CHS 

7 

7 

0 

4 . 5271 

CHS 

7 

7 

12 

4.8938 

CHS 

7 

8 

0 

3.6750 

CHS 

7 

8 

12 

4.7439 

CHS 

7 

9 

0 

6 . 7243 

CHS 

7 

9 

12 

6.3339 

These  data  were  run  through  a  program  to  generate  files  of  GPS-derived  PW  and 
RAOB-derived  PW  together,  as  seen  in  Table  8. 


Table  8.  Sample  GPS  vs.  RAOB  Comparison  File  for  Slidell,  LA 


DTG 

GPS 

Site 

GPS  PW 

RAOB 

Site 

RAOB  PW 

187 .01 

NDBC 

5.2130 

SIL 

5.8068 

187.51 

NDBC 

4.4710 

SIL 

5 .0915 

188.01 

NDBC 

4.5440 

SIL 

5.2191 

188.51 

NDBC 

3.7530 

SIL 

4.3528 

189.01 

NDBC 

3.7390 

SIL 

4.4593 

189.51 

NDBC 

3.9020 

SIL 

4 . 8850 

190 .01 

NDBC 

3.8940 

SIL 

4.3743 

190.51 

NDBC 

5.0740 

SIL 

5.7159 

191 .01 

NDBC 

4.4040 

SIL 

5.3123 

191.51 

NDBC 

4 . 6320 

SIL 

5.3905 

3.3.5  Output  by  DTG.  Next,  the  GPS-derived  PW  and  MM5  interpolated  PW 
values  were  written  to  a  file  titled  by  Julian  date/Julian  time/forecast  integration  time. 
Table  9  is  an  example  of  one  of  these  output  files. 
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Table  9.  Sample  Output  File  for  a  45-Hour  Forecast  Valid  8  July  2001  03  UTC.  PW  values  are  in 

centimeters. 


ID 

Lat 

Long 

IX 

JX 

GPS  PW 

MM5  PW 

BLRW 

43.22 

-90.53 

218 . 54 

138 .78 

1.5330 

1 . 8270 

DQUA 

34 .11 

-94.29 

200.33 

72 .17 

4.2180 

5.0045 

FBYN 

40.08 

-97.31 

182 .79 

115.33 

3.3970 

3.7789 

HKLO 

35.68 

-95.86 

190 . 83 

83.49 

3.5200 

4.5889 

JTNT 

33.02 

-100 . 98 

159.43 

65.04 

2 . 8280 

2 . 8529 

RWDN 

40.09 

-100 . 65 

164 . 43 

116.09 

2.2000 

2 . 6036 

MBWW 

41 . 90 

-106.19 

135.74 

131 .80 

2 .0060 

1 .8064 

3.3.6  Output  by  location.  The  next  task  was  to  group  all  data  together  by 
location.  This  involved  a  new  program  that  took  the  output  GPS  and  MM5  data  from  a 
particular  DTG  and  wrote  each  location’s  line  to  a  new  file,  which  is  shown  in  Table  10. 


Table  10.  Location-specific  PW  Data  for  Spokane,  WA. 


DTG 

ID 

GPS  PW 

MM5  PW 

187 .500.06H 

SPN1 

0 . 8400 

1.2588 

187 . 625 . 09H 

SPN1 

1 . 5220 

1 .2732 

187 . 750 . 12H 

SPN1 

2 .0170 

1.2030 

187 . 875 . 15H 

SPN1 

1.3900 

1.0499 

188.000.06H 

SPN1 

1 .3970 

1.1243 

188 . 000 . 18H 

SPN1 

1 .3970 

1 . 0859 

188 . 125 . 09H 

SPN1 

1.5500 

1.1666 

188.125.21H 

SPN1 

1.5500 

1.1892 

3.3. 7  Comparative  statistics  calculations.  Summary  statistics  were  calculated 
from  each  of  the  previously  described  fdes.  A  statistics  subroutine  was  developed  that 
calculated  the  mean  values,  bias,  correlation,  root  mean  square  (RMS)  error,  standard 
deviation,  and  n,  the  number  of  observations  available  in  each  calculation,  based  on 
equations  from  Wilks  (1995).  Table  1 1  shows  an  example  of  a  summary  statistics  file  for 
a  single  DTG.  The  contents  of  this  file  can  easily  be  imported  into  PC-based  programs 
for  additional  grouping  and  processing. 
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Table  11.  Sample  Statistical  Summary  by  DTG.  This  file  collected  all  06H  forecasts  from  the  06  UTC 
initialization  MM5  runs  in  CONUS.  One  line  of  data  was  generated  for  each  DTG  file  described  above  in 

Table  9. 


DTG/Forecast 

Init 

Corr 

Bias 

RMSE 

StDev 

Mean  GPS 

Mean  MM5 

n 

187.500.06H 

06Z 

0 .9666 

-0.2678 

0 .4472 

0.3622 

2 . 9663 

3.2341 

46 

188.500.06H 

06Z 

0 . 9485 

-0.2737 

0.4861 

0.4066 

3 .0918 

3.3655 

44 

189.500.06H 

06Z 

0.9449 

-0.3391 

0 .5044 

0.3782 

3 .4527 

3.7917 

42 

190.500.06H 

06Z 

0 . 9090 

-0.3363 

0 .5912 

0.4921 

3 .3689 

3.7052 

44 

191.500.06H 

06Z 

0 . 9568 

-0.3813 

0 . 5404 

0.3874 

3 .4713 

3.8526 

45 

192.500.06H 

06Z 

0 .9635 

-0.3721 

0.5262 

0.3765 

3.4880 

3.8601 

45 

193.500.06H 

06Z 

0 . 9581 

-0 . 1280 

0.3958 

0.3789 

3 .3698 

3.4978 

45 

194.500.06H 

06Z 

0 .9674 

-0.2316 

0 .4229 

0.3579 

3 .4582 

3.6898 

46 

By-location  files  were  also  run  through  the  statistical  summary  subroutine  to 
generate  data  for  each  location:  mean  values,  residuals,  bias,  correlation,  and  regression 


equation  slopes  and  intercepts.  Table  12  shows  an  example  of  this  combined  summary. 


Table  12.  Sample  Statistical  Summary  File  by  Location.  Each  line  was  generated  from  stripping  off 
location  lines  from  each  of  the  files  listed  such  as  that  in  Table  10. 


ID 

Corr 

Bias 

RMSE 

RMSE% 

StDev 

% St dev 

Mean  GPS 

Mean  MM5 

n 

ANP 1 

0.9938 

-0.2673 

0.2968 

11 . 6236 

0.1345 

5.2659 

2.5538 

2 . 8211 

13 

ARP  3 

0 .8072 

-0.3427 

0.5228 

12.5932 

0 .4029 

9.7060 

4 . 1512 

4 .4939 

25 

AZCN 

0.9554 

-0.1466 

0.2595 

15.0628 

0.2208 

12 .8136 

1 . 7229 

1 .8695 

17 

BARH 

0.9295 

-0.0166 

0.4668 

16.5490 

0.5387 

19.0971 

2 . 8210 

2.8376 

4 

BARN 

0 . 9474 

-0.0101 

0.2459 

10.9260 

0.2509 

11 . 1516 

2 . 2502 

2.2603 

24 

BILl 

0.7005 

0.0075 

0.2624 

15.0918 

0.2704 

15.5499 

1 . 7388 

1 . 7313 

17 

BLKV 

0 . 9844 

-0.2897 

0.3549 

11.2416 

0.2128 

6.7391 

3 . 1574 

3 . 4472 

14 

BLMM 

0.9528 

-0.4392 

0.5988 

21.5478 

0.4196 

15.0979 

2 . 7789 

3 .2181 

17 

BLRW 

0.9500 

-0.5849 

0.6719 

28 . 9181 

0.3535 

15.2167 

2 . 3234 

2 . 9082 

8 
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IV.  Results  and  Discussion 


4.1  CONUS 

4.1.1  Case  Studies.  Local  storage  restrictions  limited  the  amount  of  MM5  data 
that  could  be  downloaded  from  AFWA’s  FTP  site.  The  MM5  data  download  was  for 
only  90  days,  so  the  cases  available  were  restricted  to  a  time  period  during  the  summer  of 
2001.  Four  cases  were  chosen  and  are  discussed  below.  Each  case  was  approximately  8 
days  long,  resulting  in  four  independent  time  periods  totaling  30  days.  The  statistics 
developed  were  for  a  combination  of  the  four  cases. 

4. 1.1.1  6-14  July  2001  “Ring  of  Fire”.  In  this  case,  strong  high  pressure 
centered  near  Memphis,  TN  dominated  the  eastern  two-thirds  of  the  country  and 
restricted  precipitation  to  the  periphery  of  the  air  mass. 

The  southwest  monsoon  brought  rain  to  Arizona  and  New  Mexico.  The 
stationary  front  dropped  significant  rainfall  over  Kansas,  Missouri  and  the  Ohio  River 
Valley.  Over  the  course  of  the  week,  a  new  system  entered  the  through  the  Pacific 
northwest  and  worked  its  way  across  the  country.  Once  it  entered  the  plains,  it  prompted 
a  strong  squall  line  that  worked  its  way  across  the  country.  See  Figure  7  for  a 
representative  radar  mosaic. 
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Figure  7.  NEXRAD  Mosaic  Image  from  15  UTC  8  July  2001.  Note  the  radar  reflectivities  arcing  across 
the  northern  plains  and  the  Midwest.  Image  courtesy  National  Oceanic  and  Atmospheric  Administration 

(NOAA  2002). 

4. 1.1.2  25  July  -  2  August  2001  “ Central  Plains  Squall  Line”.  At  the 
beginning  of  this  time  period,  the  Bennuda  high  was  dominating  the  southeast  quadrant 
of  the  nation,  while  a  stationary  front  draped  across  the  central  plains.  The  southwest 
monsoon  was  bringing  rain  to  Arizona  and  New  Mexico.  The  stationary  front  was 
sending  significant  rainfall  over  Kansas,  Missouri,  and  the  Ohio  River  Valley.  Over  the 
course  of  the  week,  a  new  system  entered  the  country  through  the  Pacific  Northwest  and 
worked  its  way  across  the  country.  Once  it  entered  the  plains,  it  prompted  a  strong  squall 
line.  Figure  8  shows  a  representative  radar  mosaic. 

4.1. 1.3  11  -  18  August  2001  “ Dirty  Subtropical  High”.  During  this  time 
period,  the  Bennuda  high  was  the  primary  influence  east  of  the  Rockies.  As  seen  in 
Figure  9,  scattered  showers  and  garden-variety  thunderstonns  erupted  every  afternoon. 
The  monsoon  was  continuing  to  influence  the  desert  southwest. 
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Figure  8.  NEXRAD  Mosaic  Image  from  09  UTC  25  July  2001.  A  stationary  front  bisected  the  nation  and 
generated  daily  squall  lines.  Image  courtesy  ofNOAA  (2001). 


Figure  9.  NEXRAD  Mosaic  Image  from  00  UTC  12  August  2001.  Image  courtesy  ofNOAA  (2001). 


4. 1.1. 4  10  - 15  September  2001  “ Hurricane  Gabrielle”.  Figure  10  shows 
mosaic  imagery  from  just  after  Tropical  Storm  Gabrielle’s  landfall.  Gabrielle  formed 
over  the  southeastern  Gulf  of  Mexico  and  cut  across  the  Florida  peninsula.  At  the  same 
time,  the  southwest  monsoon  was  pumping  moisture  all  the  way  up  into  the  northern 
plains,  causing  showers  and  thunderstorms  throughout. 
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Figure  10.  NEXRAD  Mosaic  Image  from  08  UTC  14  September  2001.  This  image  was  from  just  after 
Tropical  Storm  Gabrielle’s  landfall  near  Venice,  FL.  Image  courtesy  of  NOAA  (2001). 

4.1.2  Domain  Summary.  Figure  1 1  shows  summaries  of  the  domain- wide 
comparisons  between  GPS-derived  and  MM5-calculated  precipitable  water.  In  order  to 
properly  assess  the  data,  it  is  important  to  understand  the  local  diurnal  patterns.  Figure 
11a  shows  the  mean  GPS  and  MM5  PW  values  for  each  forecast  period.  Note  the 
significant  diurnal  variation  in  the  GPS  PW.  The  GPS  PW  was  higher  during  the 
daylight  hours  and  this  results  in  higher  correlations,  lower  root  mean  square  errors  and 
lower  standard  deviations  when  compared  against  the  06  UTC  initialization  products. 

The  maximum  seen  in  the  GPS-derived  PW  at  the  06  UTC  initialization  occurs  at 
1500  local  Central  Standard  Time,  which  is  the  estimated  time  of  maximum  heating.  The 
minimum  seen  in  the  GPS  18  UTC  Initialization  occurs  just  before  local  sunrise.  Note 
the  06  UTC  and  18  UTC  patterns  crossing  over  each  other  just  before  09H  and  21H. 

This  signature  is  hereafter  referred  to  as  a  “crossover”  in  the  graph.  Both  GPS-derived 
PW  crossovers  occur  at  their  respective  local  sunrise  and  sunset.  Note  the  MM5’s  lack  of 
crossover  compared  to  the  GPS  values. 
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(a)  (b) 


Figure  11.  CONUS  Domain-Wide  Statistical  Summaries,  (a)  Mean  GPS-Derived  PW  and  MM5 
Calculated  PW.  (b)  Correlation:  GPS-Derived  PW  -  MM5-Calculated  PW.  (c)  Bias:  GPS-Derived  PW  - 
MM5 -Calculated  PW.  (d)  RMSE  of  GPS-Derived  PW  -  MM5-Calculated  PW. 

The  highest  correlations  (Figure  lib)  seemed  to  occur  during  the  hours  of 
sunlight,  which  could  be  attributed  to  the  higher  precipitable  water  content  during  the 
day.  The  crossover  occurs  just  after  local  maximum  heating  in  the  06  UTC  initialization, 
and  just  before  sunrise  in  the  18  UTC  initialization.  In  addition,  the  local  minima  in  bias 
(Figure  lie)  seemed  to  occur  during  the  day,  as  the  hours  approached  that  of  maximum 
heating.  However,  in  both  cases,  data  noise  must  be  taken  into  account  as  the  forecast 
integration  time  progressed.  Decreasing  correlation  and  bias  with  forecast  time  is 
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expected,  owing  to  the  nature  of  numerical  weather  prediction:  the  further  in  the  future 
one  attempts  to  predict,  the  higher  the  error  of  the  predictand. 

The  model’s  consistent  moist  bias  (Figure  1  lc)  arises  from  the  nature  of  the 
moisture  variables  that  are  assimilated  into  the  model.  For  the  06  UTC  model  run,  drier 
moisture  variables  are  entering  the  model,  and  that  lack  of  moisture  carries  throughout. 
The  converse  is  true  with  the  18  UTC  model  run.  Figure  1  la  shows  the  model’s  lack  of 
diurnal  variation  that  the  GPS-derived  PW  can  provide. 

RMSE  in  Figure  lid  shows  the  same  trends  as  correlation  and  bias.  The  highest 
values  of  GPS  PW,  which  occured  during  daylight  hours,  produced  the  least  RMSE.  The 
crossover  occured  just  after  maximum  heating  in  the  06  UTC  run  and  just  after  minimum 
heating  in  the  18  UTC  run. 

4.1.3  By-Location  Summary  Data.  Each  forecast  period  for  both  initialization 
times  was  analyzed  for  each  location  in  the  CONUS  GPS  network.  A  thorough 
discussion  of  the  6-hour  forecasts  for  both  initialization  times  will  be  provided  here; 
results  for  all  forecast  times  are  in  Appendix  C.  Sections  4. 1 .2. 1  and  4. 1 .2.2  discuss  all 
locations’  statistics,  while  Sections  4. 1.2.3  and  4. 1.2.4  review  relationships  that  surfaced 
from  analysis  of  these  statistics. 

4. 1.3.1  Summary  statistics  for  the  06  UTC  model  initialization.  In  this 
section,  trends  in  comparisons  between  the  GPS  site  and  the  MM5  output  for  each 
location  will  be  reviewed.  Figure  12  shows  the  mean  correlation  of  each  location’s  06 
hour  forecast  in  the  CONUS  GPS  network.  Medicine  Bow,  Wyoming’s  (MBWW)  low 
correlation  stands  out,  but  its  low  corresponding  number  of  samples  will  explain  the 
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anomaly.  The  mean  correlation  for  all  GPS  receiver  locations  was  90.0%,  while  the 
mean  correlation  for  locations  with  more  than  10  samples  was  91.5%. 
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Figure  12.  Mean  Correlation  of  Each  GPS  Receiver  Location:  CONUS  06  UTC  Initialization,  06-Hour 
Forecast.  The  locations  with  gray  columns  were  calculated  with  less  than  10  samples. 

Figure  13  shows  the  mean  bias  at  each  location.  As  is  seen  in  the  domain- wide 
bias  summary  (Figure  1  lc),  there  was  an  overwhelming  moist  bias  in  the  majority  of  the 
locations.  It  is  interesting  to  point  out  that  of  the  eleven  sites  with  positive  bias,  nine  of 
the  sites  are  west  of  the  Mississippi  River.  The  dependence  of  the  bias  on  the  number  of 
samples  in  each  location  calculation  seems  to  be  of  minimal  value  in  this  case:  the  mean 
bias  of  all  locations  was  -0.240  cm,  while  the  mean  bias  of  only  locations  with  more  than 
10  samples  was  -0.241  cm.  The  western  sites’  drier  model  outputs  most  likely  were  the 
cause  of  a  positive  bias.  Sites  with  a  mean  GPS  PW  reading  of  more  than  4  cm  had  a 
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bias  of-0.38  cm,  while  those  with  mean  PW  readings  of  less  than  2  cm  had  a  bias  of- 
0.19  cm. 


■  n>10  ■n<10 


Figure  13.  Mean  Bias  of  Each  GPS  Receiver  Location:  CONUS  06  UTC  Initialization,  06-Flour  Forecast. 
The  gray  columns  are  locations  that  had  less  than  10  samples  in  the  statistic’s  calculation.  A  negative  bias 
signifies  the  model  having  more  moisture  than  the  GPS  receiver  site. 

Figure  14  shows  the  RMSE  expressed  as  a  percentage  of  the  location’s  mean  GPS 
precipitable  water  value.  This  nonnalizes  the  environmental  differences  between  arid 
(i.e.,  Arizona)  and  humid  (i.e.,  Florida)  regions  throughout  the  domain.  Like  correlation 
and  bias,  most  of  the  high  RMSE  locations  also  happen  to  have  a  low  sample  set. 
However,  if  we  were  to  remove  all  low  sample  set  sites,  two  sites  still  stand  out  as  having 
high  RMSEs,  Flagstaff,  AZ  (FST1)  and  La  Jolla,  CA  (SI03).  The  mean  normalized 
RMSE  for  all  sites  is  16.49%  of  the  mean  GPS  PW  value,  while  the  mean  for  sites  with 
more  than  10  samples  is  15.5%. 
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Figure  14.  Mean  Normalized  RMSE  of  Each  GPS  Receiver  Location:  CONUS  06  UTC  Initialization,  06 
Hour  Forecast.  The  value  calculated  as  (RMSE/mean  GPS  PW)*100.  The  gray  columns  are  locations  that 
had  less  than  10  samples  in  the  statistic’s  calculation. 

Standard  deviation  as  a  percentage  of  mean  GPS  precipitable  water  is  shown  in 
Figure  15.  Again,  by  considering  those  sites  with  less  than  10  samples  as  questionable, 
many  of  the  highest  standard  deviation-sites  can  be  eliminated  from  the  summary.  Even 
if  the  low-sample  sites  are  eliminated,  La  Jolla,  CA  (SI03)  remains  as  an  anomalously 
high  standard  deviation.  All  GPS  sites  produced  a  mean  nonnalized  standard  deviation 
of  12.37%,  while  the  mean  of  sites  with  more  than  10  samples  was  1 1.8%. 

4.13.2  Summary  statistics  for  the  18  UTC  model  initialization.  The  18  UTC 
model  output  was  treated  as  a  separate  entity  in  this  study  to  offset  any  diurnal 
differences  between  the  twice-daily  runs. 
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Figure  15.  Mean  Normalized  Standard  Deviation  of  Each  GPS  Receiver  Location:  CONUS  06  UTC 
Initialization,  06  Hour  Forecast.  The  value  is  calculated  as  (standard  deviation/mean  GPS  PW)*100.  The 
gray  columns  are  locations  that  had  less  than  10  samples  in  the  statistic’s  calculation. 

Correlation  at  each  of  the  GPS  sites  is  shown  in  Figure  16.  Again,  the  lowest 
correlations  have  less  than  10  samples  available  for  calculation,  but  Flagstaff,  AZ  (FST1) 
still  has  a  low  value.  The  mean  correlation  of  all  sites  was  84.2%,  while  the  mean 
correlation  of  all  sites  with  more  than  10  samples  was  87.1%. 
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Figure  16.  Mean  Correlation  of  Each  GPS  Receiver  Location:  CONUS  18  UTC  Initialization,  06-Hour 
Forecast.  The  locations  with  gray  columns  were  calculated  with  less  than  10  samples. 
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Figure  17.  Mean  Bias  of  Each  GPS  Receiver  Location:  CONUS  18  UTC  Initialization,  06-Hour  Forecast. 
The  locations  with  gray  columns  were  calculated  with  less  than  10  samples.  A  negative  bias  signifies  the 
model  having  more  moisture  than  the  GPS  receiver  site. 
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Figure  17  shows  the  mean  bias  for  each  GPS  site.  Like  the  06  UTC  model  run, 
there  are  very  few  locations  with  positive  bias.  Two  of  the  three  positive  bias  locations 
had  low  samples,  and  the  remaining  site  is  Boulder,  CO  (DSRC),  which  is  in  a  relatively 
arid  location.  The  mean  bias  of  all  sites  was  -0.237,  while  the  mean  bias  of  sites  with 
more  than  10  samples  was  -0.255,  more  negative  due  to  removing  Bartlett,  NH’s 
(BARH)  anomalous  statistic. 

Figure  18  shows  the  normalized  mean  RMSE  for  the  18  UTC  model  run.  The 
anomalous  sites  with  more  than  10  samples  were  Chico,  CA  (CHOI),  Flagstaff,  AZ 
(FST1),  La  Jolla,  CA  (SI03),  and  Wolcott,  IN  (WLCI).  The  mean  normalized  RMSE  for 
all  sites  was  17.9%,  while  that  for  sites  with  more  than  10  samples  was  16.7%. 
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Figure  18.  Mean  Normalized  RMSE  of  Each  GPS  Receiver  Location:  CONUS  18  UTC  Initialization,  06- 
Hour  Forecast.  The  value  is  calculated  as  (RMSE/mean  GPS  PW)*100.  The  locations  with  gray  columns 

were  calculated  with  less  than  10  samples. 
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The  mean  normalized  standard  deviation  is  shown  in  Figure  19.  The  mean 
normalized  standard  deviation  for  all  sites  was  15.16%,  while  those  sites  with  more  than 
10  samples  had  a  mean  of  14. 15%. 
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Figure  19.  Mean  Normalized  Standard  Deviation  of  Each  GPS  Receiver  Location:  CONUS  18  UTC 
Initialization,  06-Hour  Forecast.  The  value  is  calculated  as  (standard  deviation/mean  GPS  PW)*100.  The 
locations  with  gray  columns  were  calculated  with  less  than  10  samples. 

4. 1.3. 3  Dependence  on  number  of  observations.  As  evidenced  by  the 
previous  two  sections,  many  of  the  statistics  were  altered  due  to  some  locations  having 
few  GPS  observations  available.  Figures  20  and  21  show  the  number  of  data  points 
available  for  generating  the  statistics  in  Sections  4. 1 .2. 1  and  4. 1.2.2.  The  mean  n  for  the 
calculations  from  the  06  UTC  06  hour  forecasts  was  18.4,  while  stripping  the  sites  with 
less  than  10  samples  provided  a  mean  n  of  20.4.  For  the  18  UTC  model  run,  the  total 
mean  n  was  17.3,  while  the  mean  n  of  those  sites  with  10  or  more  samples  was  19.3. 
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Figure  20.  Number  of  Observations  Available  for  Calculating  the  06  UTC  Initialization,  06  Hour  Forecast 

Statistics. 


25 


20 


15 


10 


5 


0 


»  >  ->  <■  k  ^  >- ; 


doooOzggoSi 


Jv 


CO  CO  CO  h 


GPS  Receiver  Location 


3n  <  10 


In  >  10 


Figure  21.  Number  of  Observations  Available  for  Calculating  the  18  UTC  Initialization,  06  Hour  Forecast 

Statistics. 
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4.1.4  Special  Studies. 

4. 1.4.1  Moist  vs.  Dry  Regimes.  The  differences  between  moist  regime 
and  dry  regime  sites  are  shown  here.  The  statistics  were  separated  into  those  sites  with 
mean  GPS  PW  values  greater  than  4  cm,  and  those  with  mean  GPS  PW  values  of  less 
than  2  cm.  The  18  UTC  initialization,  6  hour  forecast  is  the  only  one  reviewed  here. 
Other  date/time  groups  performed  comparably.  Figure  22  shows  the  increased  error  and 
noise  attributed  to  the  less  humid  GPS  receiver  sites,  and  how  the  MM5  depicts  those 
moisture  patterns. 


(c) 

Figure  22.  Moist  Sites  vs.  Dry  Sites  Statistical  Summaries:  CONUS  18  UTC  Initialization,  06  Hour 
Forecast,  (a)  Correlation  (b)  Mean  Bias.  Bias  is  defined  as  (GPS  PW  -  MM5  PW)  (c)  Mean  Normalized 
RMSE  and  Standard  Deviation.  RMSE  calculated  as  (RMSE/mean  GPS  PW)*100  and  standard  deviation 
calculated  as  (st  dev/mean  GPS  PW)*100.  Dry  sites  had  a  mean  GPS  PW  values  of  less  than  2  cm,  while 
the  moist  sites  had  a  mean  GPS  PW  values  of  more  than  4  cm. 
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4. 1.4.2  Error  Dependence  on  Elevation  and  Elevation  Residual.  One  of 
the  sources  of  error  in  this  study  was  the  terrain  height  difference  between  each  GPS  site 
and  its  MM5 -interpolated  site  elevation,  based  on  the  GRIB  file’s  terrain  height 
parameter.  In  addition,  the  inverse  proportion  between  site  elevation  and  mean 
precipitable  water  had  an  impact  on  the  statistics.  The  elevation  values  for  each  GPS 
receiver  site  are  in  Appendix  A. 

The  mean  normalized  standard  deviation  for  each  site  was  plotted  against  the  GPS 
site  elevations  and  the  difference  between  the  GPS  site  elevation  and  the  MM5 
interpolated  elevation.  The  expected  relationship  for  this  comparison  was  that  the  lower 
elevation  sites,  having  more  vertical  atmosphere  through  which  a  GPS  signal  could 
refract,  would  have  the  highest  standard  deviation,  and  that  the  higher  elevation  sites 
would  have  smaller  standard  deviations,  such  that  an  inverse  proportionality  would  exist. 
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Figure  23.  Elevation  Comparisons:  CONUS  06  UTC  Initialization,  06  Hour  Forecast.  The  diamonds  are 
sites  with  n  >  10,  while  the  stars  are  sites  with  n  <  10.  (a)  Mean  Normalized  Standard  Deviation  Plotted 
Against  Absolute  Value  of  Elevation  Residual,  (b)  Mean  Normalized  Standard  Deviation  Plotted  Against 

GPS  Site  Elevation. 
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Figure  23  shows  the  results  of  the  two  comparisons.  Sites  with  less  than  10 


samples  in  the  calculation  were  displayed  in  a  different  shape  to  highlight  their  positions 
on  the  chart.  The  expected  relationship  did  not  appear  in  these  cases,  but  there  are 
numerous  other  factors  that  could  be  clouding  the  expected  relationship,  such  as  model 
performance  at  high  elevations. 

The  results  seen  in  Figure  23  seemed  to  agree  better  with  the  comparison  made  in 
Section  4.1.3,  that  drier  GPS  sites  had  higher  standard  deviations  than  more  humid  sites. 
Most  of  the  high-elevation  GPS  sites  were  in  arid  locations,  to  include  Aztec,  NM,  Grand 
Junction,  CO  and  Flagstaff,  AZ. 

4.1.5  RAOB  Comparison.  GPS  sites  within  a  prescribed  distance  of  a  RAOB  site 
(as  explained  in  Section  3.1.3)  underwent  additional  analysis.  The  results  are  shown  and 
discussed  below. 


Table  13.  Summary  of  GPS-RAOB  Comparisons  in  CONUS.  Geodetic  information  about  the  RAOB  sites 

is  provided  in  Appendix  C. 
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Table  13  shows  the  summaries  of  the  GPS-RAOB  comparisons.  Note  the 
differences  between  inland  and  coastal  sites.  All  sites  showed  the  radiosondes  producing 
higher  average  PW  measurements  than  the  GPS  receivers.  A  likely  explanation  for  this 
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negative  bias  is  the  possibility  of  moisture  loading  when  a  radiosonde  travels  through  a 
cloud  or  precipitation  layer. 

This  study  was  conducted  during  the  wannest  and  most  humid  of  the  year  (July- 
September  2001).  This  impacts  how  high  the  PW  readings  can  become,  particularly 
along  the  coast.  Another  reason  for  such  high  radiosonde  readouts  is  the  coastal  sites  are 
all  on  the  eastern  coasts  (either  Atlantic  or  Gulf  of  Mexico),  thus  being  susceptible  to  the 
prevailing  westerly  winds  that  would  tend  to  send  the  radiosonde  balloons  over  the  water, 
perhaps  to  air  with  higher  PW.  In  addition,  it  is  appropriate  to  point  out  the  differences 
in  how  GPS-derived  PW  is  calculated  compared  to  radiosonde  PW,  as  detailed  in  Section 
3.2.8.  Recall  that  the  GPS  measurements  infer  PW  from  the  refraction  of  the  signal 
through  the  total  atmosphere,  while  the  RAOB  is  integrating  layers  of  mean  mixing  ratio 
through  the  troposphere  and  perhaps  part  of  the  stratosphere.  Figure  24  shows  some 
statistics  comparing  inland  and  coastal  sites.  The  statistics  in  this  figure  are  calculated 
only  from  the  sites  listed  in  Table  13. 


_ Location _ 

■  Mean  GPS  PW  □  Mean  RAOB  PW 
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■  %RMSE  IS  %Standard  Deviation 
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Figure  24.  GPS/RAOB  Coastal  vs.  inland  Statistical  Summaries,  (a)  Mean  GPS  and  RAOB  PW  Grouped 
by  Region,  (b)  Mean  Normalized  RMSE  and  Standard  Deviation.  The  RMSE  is  calculated  as 
(RMSE/mean  GPS  PW  value)*  100  and  standard  deviation  is  calculated  as  (standard  deviation/mean  GPS 

PW  value)*  100. 
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4.2  Alaska 


4.2.1  Case  Study.  There  was  little  choice  in  finding  a  time  period  for  study  in 
Alaska.  The  choices  for  which  days  to  perform  comparisons  was  restricted  to  the  90-day 
archive  of  MM5  GRIB  data.  During  the  period  of  time  covered  in  AFIT’s  MM5  archive, 
there  was  only  one  24-day  window  with  GPS-MET  observations  encompassing  all  four 
Alaska  GPS  sites.  At  the  other  times,  at  least  one  of  the  receiver  sites  did  not  produce 
data.  Therefore,  the  Alaska  study  took  place  from  6-29  July  2001.  A  number  of 
extratropical  cyclones  still  traversed  the  study  area,  bringing  the  variations  in  moisture 
that  were  desired  for  a  good  sample.  Figure  25  shows  a  representative  satellite  image, 
with  an  extratropical  cyclone  moving  across  the  state.  During  this  period  of  study,  a 
cyclone  such  as  this  one  traversed  the  state  approximately  once  a  week.  The  satellite 
images  available  for  this  time  period  could  only  resolve  the  southern  two-thirds  of  the 
state,  but  this  didn’t  impact  the  quality  of  the  study,  for  all  four  of  the  Alaska  GPS 
receiver  sites  were  in  the  southern  two-thirds  of  the  state. 


Figure  25.  Representative  Alaska  IR  Satellite  Image  from  12  UTC  19  July  2001.  Image  courtesy  of 

NO AA  (2001). 

4.2.2  Domain  Summary.  Figure  26  shows  the  summaries  of  the  domain-wide 
comparisons  between  the  Alaska  GPS-MET  network  and  the  15  km  Alaska  MM5 
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window.  The  GPS  observations  were  only  those  that  were  compared  with  MM5  data.  If 
no  MM5  data  was  available  on  a  particular  model  run,  then  no  GPS  data  was  collected 
for  that  DTG. 

Figure  26a  shows  the  mean  GPS  PW  and  mean  MM5  PW.  The  maximum  seen  in 
the  GPS  12  UTC  initialization  occurs  at  1800  Alaska  Time,  which  is  the  estimated  time 
of  maximum  heating.  The  minimum  seen  in  the  GPS  00  UTC  initialization  occurs  just 
before  local  sunrise.  Both  crossovers  occur  just  before  their  local  sunset.  Note  the  lack 
of  diurnal  variation  in  the  MM5  lines.  The  diurnal  variations  are  similar  to  what  is  seen 
in  Figure  1 1  for  CONUS. 

It  is  important  to  point  out  that  diurnal  cycles  are  different  in  Alaska  than  in 
CONUS.  In  Fairbanks,  sunrise  in  July  was  between  0213  (1  July)  and  0349  (31  July) 
local  time,  while  its  sunsets  ranged  from  2335  (1  July)  through  2203  (3 1  July).  This 
resulted  in  a  larger  maximum  in  the  mean  GPS  PW  plot  to  accommodate  for  the  longer 
period  of  heating.  On  these  charts,  sunrise  occurred  between  the  12-  and  15-hour 
forecasts  on  the  00  UTC  initialization  only.  Sunsets  were  at  the  09-hour  forecast  time  on 
the  00  UTC  line  and  the  21-hour  forecast  on  the  12  UTC  line.  Like  the  CONUS  scenario, 
the  MM5  output  doesn’t  seem  to  reflect  the  impacts  of  daily  heating  on  its  precipitable 
water  values. 

Figure  26b  is  the  mean  correlation  of  the  Alaska  domain,  while  Figure  26c  shows 
the  mean  bias  throughout  the  domain.  The  crossover  between  the  06-  and  09-hour 
forecast  occurs  as  the  00  UTC  model  run  is  about  to  experience  sunset,  while,  at  the  same 
time,  the  12  UTC  model  has  experienced  sunrise.  The  best  correlation  seemed  to  occur 
in  the  00  UTC  initialization,  when  maximum  heating  was  not  taken  into  account  during 
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this  time  period.  As  is  expected,  the  model  run  with  the  minimum  of  bias  has  the  better 
correlation.  The  model  had  a  dry  bias  in  this  theater,  and  the  model’s  lack  of  diurnal 
variation  resulted  in  a  better-looking  performance  at  the  00  UTC  model  run. 
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Figure  26.  Alaska  Domain-Wide  Statistical  Summaries,  (a)  Mean  GPS-Derived  and  MM5-Calculated 
PW.  (b)  Correlation:  GPS-Derived  PW  -  MM5-Calculated  PW  (c)  Bias:  GPS-Derived  PW  -  MM5- 
Calculated  PW.  (d)  RMSE  of  GPS-Derived  PW  -  MM5-Calculated  PW. 

Finally,  Figure  26d  shows  the  RMSE  for  the  comparisons.  Again,  the  errors 
seemed  to  be  highest  during  the  parts  of  the  day  with  solar  heating.  The  lowest  errors 
occur  at  nighttime,  between  midnight  and  0600L.  It  is  unusual  that  the  12  UTC 
initialization’s  RMSE  starts  out  lower  at  the  06-hour  forecast,  and  then  increases  with 
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forecast  integration  time.  This  is  again  attributed  to  the  onset  of  maximum  heating  as  the 
forecast  period  progresses. 

4.2.3  By-Location  Summary  Data.  A  clearer  picture  of  the  comparison  can  be 
seen  looking  at  individual  location  data.  The  06-hour  forecasts  for  the  00  and  12  UTC 
model  runs  will  be  discussed  here,  while  the  complete  data  summaries  are  provided  in 
Appendix  C. 

4. 2. 3.1  Summary  statistics  for  the  00  UTC  model  initialization.  In  this 
section,  trends  in  comparisons  between  the  GPS  site  and  the  MM5  output  for  each 
location  will  be  reviewed.  In  this  theater,  all  locations  averaged  more  than  10 
observations,  so  no  separate  “low-n”  statistics  needed  to  be  computed. 

Figure  27a  shows  the  mean  correlation  of  the  00  UTC  06  hour  forecast.  All 
correlations  were  at  least  80%,  which  is  a  desirable  value.  The  mean  correlation  was 
89%. 

Figure  27b  is  the  mean  bias  of  each  location.  As  was  seen  in  the  domain- wide 
data,  most  of  this  case  study  showed  the  model  having  a  dry  bias  compared  to  the  GPS 
network.  This  is  corroborated  here,  showing  only  a  minimal  moist  bias  at  the  two 
northernmost  sites,  Central  (CENA)  and  College  (CLGO).  The  mean  bias  was  0.8  mm, 
with  the  GPS  sites  more  moist  than  the  MM5. 

Figures  27c  and  27d  are  the  mean  normalized  RMSE  and  standard  deviation  for 
the  Alaska  locations.  All  of  the  sites  performed  well,  with  a  mean  normalized  RMSE  of 
10.9%,  and  the  mean  nonnalized  standard  deviation  of  only  8.81%.  College,  AK, 
performed  significantly  better  than  the  other  three  sites,  bringing  to  light  a  concern  about 
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the  differences  between  the  GPS  sensors.  The  College  GPS  site  is  part  of  a  sub-network 
independent  of  NOAA’s  wind  profiler  network,  which  controls  the  other  three  GPS-MET 
sites  in  Alaska.  The  College  sensor  has  a  different  antenna  than  the  other  three  locations, 
a  TRM33429.00  L1/L2  Micro  Centered  with  Ground  Plane,  compared  to  the  TRM22020 
L1/L2  Compact  with  Ground  Plane  at  the  other  three  sites. 
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Figure  27.  Alaska  By-Location  Statistical  Summaries:  00  UTC  Initialization,  06  Hour  Forecast,  (a)  Mean 
Correlation,  (b)  Mean  Bias.  A  negative  bias  signifies  the  model  having  more  moisture  than  the  GPS 
receiver  site,  (c)  Mean  Normalized  RMSE.  The  value  calculated  as  (RMSE/mean  GPS  PW)*  100.  (d) 
Mean  Normalized  Standard  Deviation.  The  value  is  calculated  as  (standard  deviation/mean  GPS 

PW)*100. 


4.23.2  Summary  statistics  for  the  12  UTC  model  initialization.  In  this 
section,  trends  in  comparisons  from  the  12  UTC  model  run  will  be  reviewed. 
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Figure  28.  Alaska  By-Location  Statistical  Summaries:  12  UTC  Initialization,  06  Hour  Forecast,  (a)  Mean 
Correlation,  (b)  Mean  Bias.  A  negative  bias  signifies  the  model  having  more  moisture  than  the  GPS 
receiver  site,  (c)  Mean  Normalized  RMSE.  The  value  is  calculated  as  (RMSE/mean  GPS  PW  value)*  100. 
(d)  Mean  Normalized  Standard  Deviation.  The  value  is  calculated  as  (standard  deviation/mean  GPS 

PW)*100. 

Figure  28a  shows  the  correlation  between  the  GPS  network  observations  and  the 
model  observations’  6  hour  forecasts  that  were  valid  at  the  same  time.  All  four  sites 
showed  reasonable  correlations,  with  the  mean  of  all  sites  being  88.01%.  Figure  28b  is 
the  bias  for  the  four  locations.  Note  the  distinct  positive  bias  at  all  four  locations,  which 
coincided  with  the  stronger  positive  bias  on  the  12  UTC  forecast  line  in  Figure  26c,  the 
domain-wide  mean  bias.  Talkeetna  and  Glenallen  have  the  strongest  biases,  and  it  is  of 
note  that  those  two  stations  are  the  furthest  south.  The  mean  bias  for  all  four  sites  is  1.69 


mm. 


Figure  28c  shows  the  mean  normalized  RMSE  for  all  four  locations.  As  is  the 
case  with  the  bias,  the  southernmost  two  sites  have  the  highest  percentages  of  RMSE, 
with  the  mean  through  all  four  sites  being  13.43%.  The  mean  normalized  standard 
deviation  is  shown  in  Figure  28d.  In  this  case,  the  stations  with  the  highest  standard 
deviations,  College  and  Central,  have  the  smallest  biases  and  RMSEs. 

4.2.4  RAOB  Comparison.  In  the  Alaska  theater,  only  one  of  the  four  GPS  sites 
was  near  a  RAOB  site:  College  (CLGO)  is  5.59  km  away  from  the  Fairbanks  (FAI) 
radiosonde  launch  site.  The  raw  radiosonde  data  was  downloaded  from  the  NOAA  FSL 
RAOB  site  (http://raob.fsl.noaa.gov)  and  PW  was  computed  using  a  NOAA  algorithm. 
However,  the  algorithm,  when  computed  on  only  the  mandatory  and  significant  levels 
that  the  web  site  provides,  tends  to  overestimate  the  radiosonde  PW  values.  This  method 
of  computation  is  different  than  how  NOAA  ordinarily  computes  PW.  NOAA  has  the 
ability  to  use  the  balloon  output  that’s  transmitted  every  second,  providing  a  much  more 
robust  database. 

Thirty-seven  soundings  were  evaluated  with  their  respective  GPS  PW 
measurements  and  the  summary  statistics  are  shown  in  Table  14  below.  Like  in  CONUS, 
the  RAOB  produced  a  higher  average  PW  value,  but  in  this  case  the  differences  are 
attributed  to  the  errors  inherent  in  computing  the  radiosonde  PWs  without  using  enough 
levels. 
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Table  14.  Summary  Statistics  of  Fairbanks  GPS-PW  and  RAOB-PW  Comparison. 


Statistic 

Value 

Mean  GPS  PW 

2.07 

Mean  RAOB  PW 

2.70 

Correlation 

0.86 

Bias 

-0.63 

RMSE 

0.50 

Standard  Deviation 

0.33 

n 

37 
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V.  Conclusions 


This  study  compared  GPS-derived  precipitable  water  with  the  AFWA  MM5,  in 
hopes  of  recommending  future  Air  Force  actions  regarding  the  precipitable  water  data 
set.  The  potential  impacts  of  the  GPS  PW  on  moisture  forecasts  provide  much  promise 
for  assimilation  into  Air  Force  operational  models,  particularly  when  the  3DVAR 
assimilation  system  comes  on  line  at  AFWA.  In  addition,  AFWA  could  also  investigate 
placement  of  their  own  GPS-MET  sensors  in  data  sparse  locations;  the  passive  remote 
sensing  capability  would  serve  military  operations  well. 

It  is  important  to  point  out  here  that  the  results  generated  in  this  study  were 
restricted  to  the  summer  season  only,  so  they  may  not  accurately  represent  other  times  of 
year.  Also,  the  errors  that  did  develop  cannot  be  singly  attributed  to  either  shortcomings 
in  the  GPS  observing  network  nor  that  of  the  MM5.  These  conclusions  emphasize  the 
quantitative  differences  between  the  two  data  sets  and  qualitative  observations  about  the 
model  and  the  GPS  observing  system. 

The  variations  that  were  expected  between  the  two  theaters  do  exist,  but  it  is  not 
known  which  data  set  contributed  more  to  the  differences.  It  is  likely  that  the  MM5 
physics  packages,  which  are  the  same  in  both  CONUS  and  Alaska,  act  differently  in  the 
two  climate  regimes. 


65 


The  biases  that  originated  from  these  comparisons  were  expected  to  have  been  the 
same  order  of  magnitude  as  other  independent  comparisons  between  GPS  networks  and 
NWP  models.  This  was  found  to  be  true  in  both  CONUS  and  Alaska. 

5.1  CONUS  Conclusions 

5.1.1  Domain-Wide  Conclusions.  The  GPS  PW  patterns  demonstrate  the 
significant  diurnal  variations  that  cannot  be  captured  with  the  existing  radiosonde 
network.  The  MM5  values  performed  comparably  to  the  GPS  PW  at  initialization  times, 
but  the  MM5  does  not  account  for  the  diurnal  changes  that  occur;  the  lack  of  diurnal 
changes  in  the  MM5  resulted  in  increased  error  as  the  forecast  progressed. 

The  MM5  values  were  consistently  more  moist  than  what  was  measured  with  the 
GPS  receivers.  This  could  be  attributed  to  the  consistent  moist  bias  the  radiosondes 
seemed  to  have  compared  to  the  GPS  network.  In  addition,  the  MM5’s  18  UTC  model 
run  initialized  with  higher  moisture  than  the  06  UTC  run.  However,  the  lack  of  diurnal 
variation  in  the  MM5  moisture  patterns  resulted  in  consistently  higher  moisture  values 
throughout  the  period. 

Additionally,  the  06  UTC  model  runs  matched  the  GPS  network  better  than  did 
the  18  UTC  runs.  A  possible  reason  for  this  is  the  higher  GPS  values  in  the  first  15  hours 
of  the  06  UTC  forecast  matching  the  consistently  higher  MM5  forecast  outputs.  Finally, 
in  both  model  runs,  the  RMSE  approached  minimum  values  during  the  day’s  local  peak 
heating,  when  the  GPS  PW  values  were  the  highest. 
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5.1.2  By-Location  Conclusions.  When  assessing  individual  location  trends,  it  is 
apparent  how  important  it  is  to  have  a  sufficient  sample  size  to  compute  the  statistics. 
Any  statistics  calculated  with  less  than  10  observation-model  pairs  were  taken  out  of  the 
calculation  and  a  separate  statistic  was  made  available  for  comparison. 

Significant  errors  persisted  in  some  locations  despite  removing  those  sites  with 
less  than  10  observations  available.  The  trend  in  these  sites  is  that  most  were  in  the 
western  United  States,  and  one  site  in  particular  was  on  the  west  coast.  Western  sites 
may  have  inherent  model  errors  due  to  the  lack  of  upstream  initialization  information. 

A  comparison  was  made  with  coastal  versus  non-coastal  sites  and  the  differences 
demonstrated  the  impact  the  high  number  of  coastal  sites  has  on  the  quality  of  the 
network  when  compared  to  the  MM5.  It  is  also  of  note  that  most  of  the  coastal  sites  are 
Coast  Guard/ Army  Corps  of  Engineers  sites,  which  often  have  different  models  of  GPS 
receivers  and  antennas  than  many  of  the  inland  sites.  The  coastal  sites  had  higher  errors 
and  biases  than  the  inland  sites. 

5.2  Alaska  Conclusions 

5.2.1  Domain-Wide  Conclusions.  Alaska’s  GPS  network  consistently  observed 
higher  PW  values  than  the  MM5  output.  In  this  case,  the  best  correlations  occurred 
during  minima  in  heating.  Alaska’s  summertime  sunrise  and  sunset  schedules  created  an 
interesting  diurnal  PW  pattern.  These  caused  longer  heating  periods  and  probably  drove 
the  GPS  network’s  readings  to  be  much  higher  than  the  MM5. 
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5.2.2  By-Location  Conclusions.  Two  interesting  points  came  out  of  the  by¬ 
location  analyses.  First,  the  northern  sites,  College  (CLGO)  and  Central  (CENA)  had  a 
negative  model  bias  in  the  00  UTC  model  run,  likely  due  to  the  model  initializing  right 
before  local  sunset,  thus  driving  the  GPS  values  lower  than  the  MM5. 

Secondly,  the  College  (CLGO)  GPS  site  performed  markedly  better  than  the  other 
three  sites.  Two  possibilities  arise  from  this  observation.  One  is  that  the  CLGO  antenna 
is  a  different  model  than  the  other  three  in  Alaska.  The  other  option  is  the  terrain 
surrounding  the  stations  having  an  impact  on  the  prevailing  localized  weather  patterns. 

5.3  Recommendations  for  Future  Work 

Three  major  areas  require  attention  for  future  work:  comparisons  of  GPS-derived 
PW  from  other  networks  with  other  AFWA  MM5  global  domains,  assimilation  of  GPS- 
derived  values  into  the  MM5,  and  vertical  profiling  of  GPS-derived  moisture  parameters. 

Many  other  GPS-Meteorology  networks  exist  worldwide  for  various  research 
endeavors.  Matching  other  AFWA  MM5  domain  windows  with  these  GPS-MET 
networks  allows  many  opportunities  for  additional  data  and  comparisons.  Examples  of 
additional  research  areas  include  Japan,  Taiwan,  Southern  Europe,  and  Scandinavia. 

Secondly,  the  next  logical  step  would  be  to  assimilate  the  GPS-MET  data  into  the 
operational  MM5.  Using  the  3D  VAR  assimilation  would  aptly  take  advantage  of  the 
temporal  availability  of  the  GPS  data.  To  do  this  would  require  intimate  knowledge  of 
the  MM5  code  and  would  work  best  in  an  advanced  degree  program  with  a  numerical 
weather  prediction  emphasis. 


68 


Finally,  it  would  serve  well  to  investigate  how  to  take  the  one-dimensional 
precipitable  water  values  and  derive  a  vertical  profile,  based  on  other  thermodynamic 
variables.  The  other  variables  could  be  either  observed  through  other  sources  or  else 
inferred  from  the  3DVAR  initialization.  Vertical  profiling  of  GPS-MET  data  with  GOES 
sounder  data  is  currently  being  researched  and  the  results  have  been  promising. 
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Appendix  A:  Geodetic  Information 


This  data  is  provided  to  give  the  reader  detailed  information  about  the  locations, 
elevations  and  model  positioning  for  each  of  the  GPS-MET  sites  and  their  nearby  RAOB 
sites  (if  a  RAOB  site  is  within  range).  The  MM5  IX  and  MM5  JX  columns  are  the  grid 
positions  on  the  AFWA  15  km  MM5  grid  and  are  used  to  assist  in  grid-to-station 
interpolation.  Table  A-l  is  the  CONUS  geodetic  information,  while  Table  A-2  is 
Alaska’s  infonnation. 


Table  A-l.  CONUS  Geodetic  Information 


ID 

Location 

Latitude 

Longitude 

MM5 

IX 

MM5 

JX 

GPS 

Receiver 

Elevation 

(m) 

MM5 

Interpolated 
Elevation  (m) 

MM5- 

GPS  dz 
(m) 

RAOB 

RAOB  dx 
(m) 

RAOB- 

GPS  dz 
(m) 

ANP1 

Annapolis,  MD 

39.01 

-76.61 

1MW 

53 

6.24 

46.7569 

ARP3 

Aransas  Pass,  TX 

27.84 

-97.06 

11 

0 

11 

44.01 

3 

AZCN 

Aztec,  NM 

36.84 

-107.91 

1885 

1816.17 

68.8204 

BARH 

Bar  Harbor,  ME 

44.40 

-68.22 

31 

16.12 

14.8733 

BARN 

Bartlett,  NH 

44.10 

-71.16 

165 

339.19 

-174.198 

BIL1 

Billings,  MT 

45.97 

-108.00 

887 

969.19 

-82.1951 

BLKV 

Blacksburg,  VA 

37.20 

-80.41 

636 

653.26 

-17.267 

BLMM 

Bloomfield,  MO 

36.88 

-89.97 

130 

109.08 

20.9145 

BLRW 

Blue  River,  WI 

43.22 

-90.53 

226 

280.42 

-54.4268 

CCV3 

Cape  Canaveral,  FL 

28.46 

-80.55 

5 

0 

5 

2.23 

0 

CHA1 

Charleston,  SC 

32.76 

-79.84 

6 

0.26 

5.7305 

23.63 

9 

CHOI 

Chico,  CA 

39.43 

-121.66 

45 

96.61 

-51.6135 

CLK1 

Clark,  SD 

44.93 

-97.96 

440 

468.63 

-28.6326 

CNWM 

Conway,  MO 

37.52 

-92.70 

390 

388.60 

1.3908 

69.82 

4 

COVX 

Chesapeake  Light,  VA 

36.90 

-75.71 

37 

0 

37 

DQUA 

Dequeen,  AR 

34.11 

-94.29 

199 

143.04 

55.9553 

DRV1 

Driver,  VA 

36.96 

-76.56 

13 

8.88 

4.1195 

DSRC 

Boulder,  CO 

39.99 

-105.26 

1649 

1915.70 

-266.702 

40.66 

-38 

ENG1 

English  Turn,  LA 

29.88 

9 

0.78 

8.2178 

FBYN 

Fairbury,  NE 

40.08 

-97.31 

433 

449.53 

-16.5334 

FST1 

Flagstaff,  AZ 

35.22 

-111.82 

2159 

2211.78 

-52.7822 

i'aftil 

1.11 

20 

GAL1 

Galveston,  TX 

29.33 

-94.74 

10 

0 

10 

GDAC 

Granada,  CO 

37.78 

-102.18 

1159 

1119.58 

39.4105 

GWEN 

Appleton,  WA 

45.78 

-121.33 

746 

470.05 

275.9499 

HAG1 

Hagerstown,  MD 

39.55 

-77.71 

155 

190.75 

-35.7526 

HBRK 

Hillsboro,  KS 

38.30 

-97.29 

443 

442.67 

0.3285 

HDF1 

Hudson  Falls,  NY 

43.27 

-73.54 

72 

157.94 

-85.9444 

HKLO 

Haskell,  OK 

35.68 

-95.86 

221 

206.32 

14.681 

HTV1 

Hartsville,  TN 

36.36 

-86.09 

198 

211.47 

-13.4706 

HVLK 

Haviland,  KS 

38.30 

-99.11 

648 

624.85 

23.1503 

JTNT 

Jayton,  TX 

33.02 

-100.98 

711 

724.64 

-13.6392 

KYW1 

Key  West,  FL 

24.58 

-81.65 

8 

0 

8 

LMNO 

Lamont,  OK 

36.69 

-97.48 

308 

315.52 

-7.5227 

LTHM 

Lathrop,  MO 

39.58 

-94.17 

295 

293.18 

1.8147 

MBWW 

Medicine  Bow,  WY 

41.90 

-106.19 

1999 

2078.07 

-79.0701 

MC01 

Grand  Junction,  CO 

39.09 

-108.53 

1454 

1705.46 

-251.458 

MCN1 

Macon,  GA 

32.70 

-83.56 

88 

114.17 

-26.1736 

MOB1 

Mobile  Point,  AL 

30.23 

BaawgS 

9 

0 

9 

MORI 

Moriches,  NY 

40.79 

1-72.75 

8 

3.99 

4.0127 
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Appendix  A:  Geodetic  Information 


Table  A-l  (continued):  CONUS  Geodetic  Information 


ID 

Location 

Latitude 

Longitude 

MM5 

IX 

MM5 

JX 

GPS 

Receiver 

Elevation 

On) 

MM5 

Interpolated 
Elevation  (m) 

MM5- 

GPS  dz 
(m) 

RAOB 

RAOB  dx 
On) 

RAOB- 

GPS  dz 
(m) 

MRRN 

Merriman,  NE 

42.90 

-101.70 

IBM 

lUM 

991 

997.79 

-6.7922 

NDBC 

Stennis,  MS 

30.36 

-89.61 

16 

4.71 

11.2897 

SIL 

20.45 

-8 

NDS1 

Neodesha,  KS 

37.30 

-95.60 

266 

253.50 

12.4971 

NLGN 

Neligh,  NE 

42.21 

-97.80 

525 

542.78 

-17.7815 

OKOM 

Okolona,  MS 

34. OS 

-88.86 

125 

100.58 

24.4151 

PATT 

Palestine,  TX 

31.78 

-95.72 

121 

113.27 

7.7337 

PLS1 

Poison,  MT 

47.66 

-114.11 

1002 

1179.05 

-177.053 

PLTC 

Platteville,  CO 

40.18 

-104.73 

1521 

1474.26 

46.7418 

PNB1 

Penobscot,  ME 

44.45 

-68.77 

59 

21.40 

37.5984 

PRCO 

Purcell,  OK 

§EIH 

-97.52 

1 78 

331 

339.06 

-8.0615 

RWDN 

Mccook,  NE 

40.09 

-100.65 

SSH 

799 

820.98 

-21.9778 

SAV1 

Savannah,  GA 

32.14 

-81.70 

40 

22.42 

17.5801 

SEAW 

Seattle  WFO,  WA 

47.69 

-122.26 

20 

71.47 

-51.4691 

SHK1 

Sandy  Hook,  NJ 

40.47 

-74.01 

9 

3.44 

5.559 

SI03 

Scripps/La  Jolla,  CA 

32.86 

-117.25 

71 

53.60 

17.4031 

SLAI 

Slater,  I A 

41.90 

-93.69 

315 

302.78 

12.2155 

SPN1 

Spokane,  WA 

47.52 

-117.52 

752 

712.35 

39.646 

SUM1 

Summerfield,  TX 

34.83 

-102.51 

1186 

1197.10 

-11.1024 

SYCN 

Syracuse,  NY 

43.12 

-76.09 

122 

188.15 

-66.1533 

TCUN 

Tucumcari,  NM 

35.09 

-103.61 

1243 

1309.37 

-66.3683 

VCIO 

Vici,  OK 

36.07 

-99.22 

653 

605.20 

47.7974 

WDLM 

Wood  Lake,  MN 

44.67 

-95.44 

319 

315.47 

3.5298 

WHN1 

Whitney,  NE 

42.74 

-103.33 

1072 

1183.34 

-111.336 

WLCI 

Wolcott,  IN 

40.81 

-87.05 

215 

212.79 

2.2077 

WNCI 

Winchester,  IL 

39.65 

-90.48 

170 

174.93 

-4.9254 

WNFL 

Winfield,  LA 

31.90 

-92.78 

95 

49.94 

45.0612 

WSMN 

White  Sands,  NM 

32.41 

-106.35 

1229 

1299.96 

-70.955 

Table  A-2.  Alaska  Geodetic  Information 


ID 

Location 

Latitude 

Longitude 

MM5IX 

MM5 

JX 

Elevation 

(m) 

MM5 

Interpolated 
Elevation  (m) 

§§ 

RAOB 

RAOB  dx 
(m) 

RAOB- 

GPS  dz 

0*0 

CENA 

Central,  AK 

65.5 

-144.68 

75.52 

273 

528.34 

-255.34 

GNAA 

Glenallen,  AK 

62.11 

-145.97 

79.29 

586 

619.99 

-33.99 

TLKA 

Talkeetna,  AK 

62.31 

-150.42 

64.22 

154 

155.8 

-1.8 

CLGO 

College,  AK 

64.87 

-147.86 

67.63 

196 

227.2 

-31.2 

FA1 

5.59 

-61 
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Appendix  B:  RAOB  Geodetic  Information 

This  information  is  provided  to  give  the  location  and  elevation  information  for 


each  of  the  RAOB  sites  used  in  this  study. 

Table  B-l.  RAOB  Geodetic  Information  for  CONUS  and  Alaska 


Site  ID 

Site  Name 

Latitude 

(degrees) 

Longitude 

(degrees) 

Elevation 

(m) 

Nearest  GPS  Site 

Distance 

from 

Nearest 

GPS  Site 
(km) 

|  CONUS  | 

CHS 

Charleston,  SC 

32.90 

-80.03 

15 

Charleston,  SC  (CHA1) 

23.63 

CRP 

Corpus  Christi,  TX 

27.77 

-97.50 

14 

Aransas  Pass,  TX  (ARP3) 

44.01 

DEN 

Denver,  CO 

39.77 

-104.88 

1611 

Boulder,  CO  (DSRC) 

40.66 

FLG 

Flagstaff,  AZ 

35.23 

-111.82 

2179 

Flagstaff,  AZ  (FST1) 

1.11 

OTX 

Spokane,  WA 

47.68 

-117.63 

728 

Spokane,  WA  (SPN1) 

19.63 

SGF 

Springfield,  MO 

37.23 

-93.40 

394 

Conway,  MO  (CNWM) 

69.82 

SIL 

Slidell,  LA 

30.33 

-89.82 

8 

Stennis  Space  Center,  MS  (NDBC) 

20.45 

XMR 

Cape  Canaveral,  FL 

28.48 

-80.55 

5 

Cape  Canaveral,  FL  (CCV3) 

2.23 

|  Alaska  ( 

FAI 

Fairbanks,  AK 

64.82 

-147.87 

135 

College,  AK  (CLGO) 

5.59 
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Appendix  C:  Location-Specific  Statistics 

The  following  tables  provide  the  full  statistics  that  complement  the  summary 


values  discussed  in  Chapter  4  of  the  thesis  text.  Bias  is  defined  as  the  observed  GPS- 
MET  PW  value  minus  the  MM5  PW  value.  %RMSE  is  defined  as  the  RMSE  value 
divided  by  the  Mean  GPS  PW  value  times  100,  while  the  %StDev  is  defined  as  the 
Standard  Deviation  value  divided  by  the  Mean  GPS  PW  times  100.  The  tables  in  the  C-l 
series  are  for  CONUS,  while  the  tables  in  the  C-2  series  are  for  Alaska. 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-1.  CONUS  Statistics:  06  UTC  Initialization,  06H  Forecast 


ANP1 

0.9938 

ARP3 

0.8072 

AZCN 

0.9554 

BARH 

0.9295 

BARN 

BIL1 

BLKV 

2.2502 

2.2603 

1.7388 

1.7313 

3.1574 

3.4472 

LMNO 

0.9466 

14.3238 

2.9027 

3.0685 

LTHM 

0.8025 

19.015 

2.5114 

2.8452 

MBWW 

0.2617 

15.6566 

2.2564 

2.0503 

H 

OKOM 

0.8777 

14.9628 

3.8269 

4.1744 

mi 

PATT 

0.9006 

12.3924 

4.2177 

4.6501 

EJ 

PLS1 

0.8317 

17.832 

1.6691 

1.725 

PRCO 

0.9036 

3.3209 

3.5404 

RH 

RWDN 

0.9663 

2.6203 

2.792 

SAV1 

0.9496 

4.0851 

4.4407 

wm 

SPNl 

29.4426 

1.4677 

1.8594 

!®Sl 

SUM1 

13.8794 

2.7158 

2.6248 

wm\ 

Means 

0.9003 

Means  ofn>  10 

0.9146 

Appendix  C:  Location-Specific  Statistics 

Table  C-l-2.  CONUS  Statistics:  06  UTC  Initialization,  09H  Forecast 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-3.  CONUS  Statistics:  06  UTC  Initialization,  12H  Forecast 


ID 

Correlation 

ANP1 

0.9318 

ARP3 

0.7457 

AZCN 

0.9264 

BARH 

0.9338 

BARN 

0.9511 

; _ RMSE  RMSE% 

0.008  0.479  18.7213 


%Stdev 

Mean  GPS 

Mean  MM5 

n 

19.551 

2.5583 

2.5503 

12 

Means 

0.8806 

Means  of  n  >  10 

0.8938 
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ID 

Correlation 

ANP1 

0.9511 

ARP3 

0.6655 

AZCN 

0.8985 

BARN 

0.8575 

Appendix  C:  Location-Specific  Statistics 

Table  C-l-4.  CONUS  Statistics:  06  UTC  Initialization,  15H  Forecast 


Bias  RMSE  RMSE%  StDev  %Stdev  Mean  GPS  Mean  MM5  n 

0.1277  0.3608  12.9209  0.3502  12.5412  2.7921  2.6645 


BIL1 

BLKV 

12.5412 

2.7921 

3.943 

18.7875 

MB 

18.8705 

SUES 

18.1151 

1.8853 

13.1689 

2.9731 

GAL1 

0.7753 

GDAC 

0.9086 

GWEN 

HAG1 

16.5869 

1.4667 

1.6757 

7 

15.0312 

2.2717 

2.4363 

12 

HBRK 

0.9399 

HDF1 

0.9069 

HKLO 

0.8766 

HTV1 

HVLK 

17.7344 

3.1591 

3.0806 

20 

12.3335 

2.8357 

2.988 

14 

KYW1 

LMNO 

LTHM 

0.8606 

MBWW 

0.7983 

MC01 

0.8943 

MCN1 

MOB1 

0 

MORI 

MRRN 

NDS1 

NLGN 

OKOM 

PATT 

PLTC 

PNB1 

PRCO 

RWDN 

SAV1 

0.8942 

SEAW 

0.5878 

SHK1 

0.9257 

WHN1 

WLCI 

WNCI 

0.894 

WNFL 

0.8076 

WSMN 

0.8344 

Means 

0.8688 

Means  of  n  >  10 

0.8780 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-5.  CONUS  Statistics:  06  UTC  Initialization,  18H  Forecast 


RMSE% 


%Stdev  Mean  GPS  Mean  MM5  n 


12.1752 

2 

5 

791 

2.6 

14.6573 

3 

8 

432 

4. 

LMNO 

0.9664 

HE2II31 

0.2913 

8.7451 

0.2702 

8.1113 

3.3314 

3.4621 

14 

LTHM 

0.5256 

0.6398 

22.3936 

0.6725 

23.5384 

2.8571 

2.7099 

7 

MBWW 

0.5584 

0.39 

16.9715 

0.416 

18.1034 

2.2979 

2.2366 

7 

81 


Appendix  C:  Location-Specific  Statistics 

Table  C-l-6.  CONUS  Statistics:  06  UTC  Initialization,  21H  Forecast 


0.3126  13.3862 

0.5611  14.7571 


Mean  GPS 

Mean  MM5 

n 

2.3354 

2.5586 

13 

3.8021 

4.1445 

23 

34.3492 

2.9546 

2.6678 

5 

21.713 

2.423 

2.1989 

23 

'|  10.8786| 

|  0.3272| 

|  10.9656| 

|  2.9842| 

|  3.0614) 

16.4194 

2.6132 

2.635 

23 

26.4665 

2.2678 

2.5447 

13 

WNFL 

0.7853 

0.1133 

15.1181 

15.272 

4.1102 

3.9969 

19 

WSMN 

0.6562 

0.1778 

14.363 

13.7474 

2.9553 

2.7775 

10 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-7.  CONUS  Statistics:  06  UTC  Initialization,  24H  Forecast 
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Mean 


Mean  n>10 


Appendix  C:  Location-Specific  Statistics 

Table  C-l-8.  CONUS  Statistics:  18  UTC  Initialization,  06H  Forecast 


Correlation  Bias _ RMSE  RMSE%  StDev  %Stdev  Mean  GPS  Mean  MM5  i 

' _ 0.9851  -0.2339  0.3087  11.8692  0.2104  8.0883  _ 2.6008  _ 2.8348  ' 

0.5991  -0.6407  0.8151  20.9456  0.5157  13.2521  3.8914  4.5321  " 


14.7846 

2.41 

2.4194 

23 

17.8092 

1.8753 

2.0839 

17 

11.0024 

3.0474 

3.5011 

14 

12.619 

3.4534 

3.5511 

22 

9.4483 

4.9128 

5.1352 

23 

9.474 

3.3587 

3.7597 

15 

PLTC 

0.8454 

16.3639 

2.1186 

2.2153 

14 

PNB1 

0.8402 

-0.1857|  0.6208|  26.0278 1  0.6106 

25.6002 

2.3852 

2.571 

17 

PRCO 

0.9347 

12.4653 

3.686 

3.9307 

18 

84 


Appendix  C:  Location-Specific  Statistics 

Table  C-l-9.  CONUS  Statistics:  18  UTC  Initialization,  09H  Forecast 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-10.  CONUS  Statistics:  18  UTC  Initialization,  12H  Forecast 


Correlation  Bias _ 

0.934  -0.263 


0.5306 


_ 0.9039  -0.1567 

0.8782  0.2981 


0.9587 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-ll.  CONUS  Statistics:  18  UTC  Initialization,  15H  Forecast 


Mean  MM5  n 

2.5504 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-12.  CONUS  Statistics:  18  UTC  Initialization,  18H  Forecast 


Correlation  Bias 


RMSE% 


%Stdev  Mean  GPS  Mean  MM5  n 


0.078  0.2332 

-0.013  0.2774" 


HVLK 

0.8775 

-0.1119 

2.712 

2.8238 

10 

JTNT 

0.7188 

-0.1664 

0.5894  17.7343  0.5818  17.5061 

3.3234 

3.4898 

18 

KYW1 

0.6898 

-0.0873 

0.5621  11.5341  0.5724  11.7447 

4.8734 

4.9607 

17 

LMNO 

0.8846 

-0.1792 

0.5079  16.8038  0.4963  16.4217 

3.0225 

3.2017 

12 

LTHM 

0.7827 

0.0893 

2.335 

2.2457 

6 

MBWW 

0.684 

0.1754 

0.2777|  11.99321  0.2359|  10.1854 

2.3157 

2.1402 

6 

Means 


Mean  n>10 
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Appendix  C:  Location-Specific  Statistics 

Table  C-l-13.  CONUS  Statistics:  18  UTC  initialization,  21H  Forecast 


Correlation 


0.8198 


0.6877 


0.9313 


0.606 


0.9029 


GAL1 

0.357 

GDAC 

0.8439 

GWEN 

0.8752 

HAG1 

0.973 

PLTC 

0.9247 

PNB1 

0.8948 

PRCO 

0.9179 

RWDN 

0.707 

SAV1 

0.9202 

SEAW 

0.7582 

SHK1 

0.9598 

SPN1 

0.9114 

SUM1 

0.8504 

SYCN 

0.9106 

TCUN 

0.8596 

VCIO 

0.8029 

WDLM 

WHN1 

WLCI 

0.8713 

WNCI 

0.9361 

WNFL 

0.8605 

WSMN 

0.8617 

Means 


Mean  n>10 
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Table  C-l-14.  CONUS  Statistics:  18  UTC  initialization,  24H  Forecast 


PNB1 

0.8913 

-0.2955 

24.8566 

0.4555 

21.6289 

2.106 

2A 

PRCO 

0.9186 

-0.0093 

10.4113 

0.3736 

10.7282 

3.4821 

3/ 

RWDN 

0.7414 

-0.2361 

17.4554 

0.4552 

15.8672 

2.8688 

3.1 
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Table  C-2-1.  Alaska  Statistics:  00  UTC  Initialization,  06H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.8177 

-0.0159 

0.2649 

12.8416 

0.2709 

13.135 

2.0626 

2.0785 

21 

CLGO 

0.9775 

-0.0707 

0.1308 

6.0873 

0.1137 

5.2905 

2.1489 

2.2195 

16 

TLKA 

0.9248 

0.1793 

0.2527 

10.5 

0.1828 

7.5928 

2.407 

2.2277 

20 

GNAA 

0.8369 

0.2439 

0.3125 

14.4388 

0.2001 

9.2464 

2.164 

1.9201 

21 

Means 

0.8892 

0.0842 

0.2402 

10.9669 

0.1919 

8.8162 

2.1956 

2.1115 

19.5000 

Table  C-2-2.  Alaska  Statistics:  00  UTC  Initialization,  09H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.85 

-0.05 

0.25 

12.59 

0.25 

12.58 

2.00 

2.06 

22 

CLGO 

0.72 

-0.27 

0.48 

24.38 

0.41 

20.69 

1.97 

2.24 

17 

TLKA 

0.64 

-0.07 

0.39 

17.97 

0.39 

18.05 

2.18 

2.26 

22 

GNAA 

0.29 

-0.04 

0.40 

20.78 

0.41 

21.15 

1.94 

1.98 

22 

Means 

0.62 

-0.11 

0.38 

18.93 

0.37 

18.12 

2.02 

2.13 

20.7500 

Table  C-2-3.  Alaska  Statistics:  00  UTC  Initialization,  12H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.87 

-0.01 

0.20 

10.28 

0.21 

10.50 

1.98 

2.00 

22 

CLGO 

0.87 

-0.25 

0.35 

18.09 

0.26 

13.16 

1.95 

2.20 

18 

TLKA 

0.71 

-0.12 

0.36 

16.34 

0.34 

15.67 

2.18 

2.30 

23 

GNAA 

0.55 

-0.01 

0.31 

16.22 

0.32 

16.58 

1.94 

1.95 

23 

Means 

0.75 

-0.10 

0.31 

15.23 

0.28 

13.98 

2.01 

2.11 

21.5000 

Table  C-2-4.  Alaska  Statistics:  00  UTC  Initialization,  1 5H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.87 

0.07 

0.21 

10.18 

0.21 

9.93 

2.07 

2.00 

19 

CLGO 

0.72 

-0.10 

0.39 

19.72 

0.39 

19.73 

1.99 

2.09 

16 

TLKA 

0.83 

-0.03 

0.27 

11.88 

0.27 

12.12 

2.26 

2.29 

21 

GNAA 

0.67 

0.07 

0.29 

14.78 

0.29 

14.72 

1.99 

1.92 

21 

Means 

0.77 

0.00 

0.29 

14.14 

0.29 

14.12 

2.08 

2.08 

19.2500 
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Table  C-2-5.  Alaska  Statistics:  00  UTC  Initialization,  18H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.77 

0.12 

0.30 

14.57 

0.28 

13.61 

2.06 

1.93 

21 

CLGO 

0.88 

-0.06 

0.24 

11.87 

0.24 

11.83 

2.04 

2.10 

17 

TLKA 

0.83 

0.08 

0.25 

10.76 

0.24 

10.43 

2.34 

2.26 

21 

GNAA 

0.85 

0.12 

0.23 

11.17 

0.20 

9.78 

2.03 

1.92 

22 

Means 

0.83 

0.07 

0.26 

12.09 

0.24 

11.41 

2.12 

2.05 

20.2500 

Table  C-2-6.  Alaska  Statistics:  00  UTC  Initialization,  21H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.64 

0.11 

0.37 

18.15 

0.37 

17.79 

2.06 

1.95 

23 

CLGO 

0.50 

-0.15 

0.57 

29.98 

0.57 

29.92 

1.92 

2.07 

15 

TLKA 

0.59 

0.16 

0.45 

18.57 

0.43 

17.72 

2.43 

2.27 

23 

GNAA 

0.67 

0.03 

0.34 

17.57 

0.35 

17.87 

1.96 

1.92 

23 

Means 

0.60 

0.04 

0.44 

21.07 

0.43 

20.83 

2.09 

2.05 

21.0000 

Table  C-2-7.  Alaska  Statistics:  00  UTC  Initialization,  24H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.81 

0.26 

0.36 

16.09 

0.26 

11.50 

2.23 

1.98 

19 

CLGO 

0.95 

0.02 

0.17 

7.61 

0.17 

7.82 

2.18 

2.17 

16 

TLKA 

0.84 

0.27 

0.35 

13.76 

0.23 

8.90 

2.53 

2.26 

19 

GNAA 

0.86 

0.22 

0.27 

12.45 

0.16 

7.52 

2.14 

1.92 

20 

Means 

0.86 

0.19 

0.28 

12.48 

0.20 

8.94 

2.27 

2.08 

18.5000 

Table  C-2-8.  Alaska  Statistics:  12  UTC  Initialization,  06H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.8397 

0.0961 

0.2566 

12.3606 

0.2442 

11.7589 

2.0764 

1.9802 

20 

CLGO 

0.8883 

0.0495 

0.2246 

11.0112 

0.2258 

11.0704 

2.0394 

1.9898 

17 

TLKA 

0.8719 

0.2444 

0.337 

14.4228 

0.2382 

10.1915 

2.3368 

2.0924 

20 

GNAA 

0.9203 

0.2888 

0.323 

15.9488 

0.1483 

7.3224 

2.0253 

1.7365 

21 

Means 

0.8801 

0.1697 

0.2853 

13.4359 

0.2141 

10.0858 

2.1195 

1.9497 

19.5000 
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Table  C-2-8.  Alaska  Statistics:  12  UTC  Initialization,  09H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.787 

0.115 

0.3041 

14.6185 

0.2882 

13.8517 

2.0803 

1.9653 

22 

CLGO 

0.6069 

-0.0891 

0.5115 

26.6866 

0.5214 

27.2013 

1.9168 

2.0059 

15 

TLKA 

0.6803 

0.2793 

0.4847 

20.0708 

0.4055 

16.7904 

2.415 

2.1357 

22 

GNAA 

0.6954 

0.1042 

0.3525 

18.1591 

0.3446 

17.7553 

1.9411 

1.8369 

22 

Means 

0.6924 

0.1024 

0.4132 

19.8838 

0.3899 

18.8997 

2.0883 

1.9860 

20.2500 

Table  C-2-9.  Alaska  Statistics:  12  UTC  Initialization,  12H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.8136 

0.2657 

0.3698 

16.779 

0.2639 

11.9745 

2.204 

1.9383 

20 

CLGO 

0.9357 

0.0693 

0.1913 

8.9577 

0.1838 

8.6059 

2.136 

2.0667 

17 

TLKA 

0.9114 

0.3115 

0.368 

14.8229 

0.201 

8.0958 

2.4827 

2.1711 

20 

GNAA 

0.8733 

0.241 

0.2989 

14.0964 

0.1812 

8.5431 

2.1206 

1.8796 

21 

Means 

0.8835 

0.2219 

0.3070 

13.6640 

0.2075 

9.3048 

2.2358 

2.0139 

19.5000 

Table  C-2-11.  Alaska  Statistics:  12  UTC  Initialization,  1 8H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.8613 

0.1478 

0.2669 

12.728 

0.2278 

10.8611 

2.0973 

1.9495 

21 

CLGO 

0.8962 

0.0068 

0.2293 

10.9638 

0.2368 

11.3184 

2.0919 

2.0851 

16 

TLKA 

0.9501 

0.1691 

0.226 

9.278 

0.1537 

6.3099 

2.436 

2.2669 

21 

GNAA 

0.7475 

0.2401 

0.3445 

16.0953 

0.2532 

11.8271 

2.1404 

1.9003 

21 

Means 

0.8638 

0.1410 

0.2667 

12.2663 

0.2179 

10.0791 

2.1914 

2.0505 

19.7500 

Table  C-2-12.  Alaska  Statistics:  12  UTC  Initialization,  21F1  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.7476 

0.01 

0.3132 

15.8365 

0.3212 

16.2397 

1.9777 

1.9677 

20 

CLGO 

0.8168 

-0.0976 

0.3314 

16.5285 

0.3278 

16.3491 

2.005 

2.1026 

15 

TLKA 

0.7791 

-0.0386 

0.2962 

13.5837 

0.3013 

13.8175 

2.1802 

2.2189 

20 

GNAA 

0.5849 

0.0497 

0.3077 

15.746 

0.3116 

15.9428 

1.9543 

1.9046 

20 

Means 

0.7321 

-0.0191 

0.3121 

15.4237 

0.3155 

15.5873 

2.0293 

2.0485 

18.7500 
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Table  C-2-13.  Alaska  Statistics:  12  UTC  Initialization,  24H  Forecast 


ID 

Correlation 

Bias 

RMSE 

RMSE% 

StDev 

%Stdev 

Mean  GPS 

Mean  MM5 

n 

CENA 

0.7801 

0.0833 

0.2891 

14.5326 

0.2836 

14.2592 

1.9891 

1.9058 

21 

CLGO 

0.8635 

-0.1306 

0.2909 

14.9584 

0.2685 

13.8042 

1.9449 

2.0756 

16 

TLKA 

0.8187 

-0.0482 

0.2662 

12.1899 

0.2683 

12.2845 

2.1841 

2.2323 

21 

GNAA 

0.6308 

0.0223 

0.2992 

15.294 

0.3057 

15.6281 

1.956 

1.9338 

21 

Means 

0.7733 

-0.0183 

0.2864 

14.2437 

0.2815 

13.9940 

2.0185 

2.0369 

19.7500 
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